-- Logs begin at Tue 2021-08-10 04:26:44 UTC, end at Tue 2021-08-10 05:39:35 UTC. -- Aug 10 05:06:57.850629 dv-cinder-803901-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 05:06:57.859287 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 10 05:06:57 2021] *** Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: nodename: dv-cinder-803901-2-iscsi Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: machine: x86_64 Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: clock source: unix Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: pcre jit disabled Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: detected number of CPU cores: 4 Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: current working directory: / Aug 10 05:06:57.861174 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: detected binary path: /usr/bin/uwsgi-core Aug 10 05:06:57.862473 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: your processes number limit is 47680 Aug 10 05:06:57.862473 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: your memory page size is 4096 bytes Aug 10 05:06:57.862473 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: detected max file descriptor number: 2048 Aug 10 05:06:57.862473 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: lock engine: pthread robust mutexes Aug 10 05:06:57.862473 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: thunder lock: enabled Aug 10 05:06:57.862473 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 05:06:57.862473 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 10 05:06:57.905295 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: Python main interpreter initialized at 0x5635bc2a69c0 Aug 10 05:06:57.905295 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: python threads support enabled Aug 10 05:06:57.905295 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: your server socket listen backlog is limited to 100 connections Aug 10 05:06:57.905295 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: your mercy for graceful operations on workers is 90 seconds Aug 10 05:06:57.905763 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 05:06:57.905763 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: *** Operational MODE: preforking *** Aug 10 05:06:57.905955 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: *** uWSGI is running in multiple interpreter mode *** Aug 10 05:06:57.905955 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: spawned uWSGI master process (pid: 93209) Aug 10 05:06:57.907931 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: spawned uWSGI worker 1 (pid: 93210, cores: 1) Aug 10 05:06:57.907931 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: spawned uWSGI worker 2 (pid: 93211, cores: 1) Aug 10 05:06:57.907931 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 05:06:57.906175 dv-cinder-803901-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 05:06:59.544908 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 05:06:59.544908 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: from cryptography.utils import int_from_bytes Aug 10 05:06:59.545444 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 05:06:59.545444 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: from cryptography.utils import int_from_bytes Aug 10 05:06:59.546926 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 05:06:59.546926 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: from cryptography.utils import int_from_bytes Aug 10 05:06:59.547374 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 05:06:59.547374 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: from cryptography.utils import int_from_bytes Aug 10 05:07:02.239282 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 05:07:02.239839 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 05:07:02.239988 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 05:07:02.240349 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 05:07:02.240602 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 05:07:02.240982 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.241301 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.241619 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.241933 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.242259 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.242595 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.242902 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.243217 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.243536 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.243792 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.244102 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.244422 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803901-2-iscsi {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.244741 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.245046 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.245349 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.245663 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.245962 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.246281 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.246610 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.247116 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.248213 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.248213 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.248213 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.248435 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.248748 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.250644 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.250644 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.250644 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.250644 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.250644 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.250644 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803901-2-iscsi {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.251047 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.251269 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.251551 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.252491 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.252794 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.253098 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.253418 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.253733 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.254036 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.254358 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.254700 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.255019 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.255340 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.255640 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.255941 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.256245 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.256559 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.256863 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.257165 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.257412 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.257713 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.258029 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.258347 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.258682 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.258936 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.259193 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.259497 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.259811 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.260115 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.260421 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.260724 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.261023 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.261321 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.261623 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.261923 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.262337 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.262682 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.262994 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.263310 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.263612 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.263926 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.264318 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.264565 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.264867 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.265201 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.265515 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.265817 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.266130 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.266445 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.266775 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.267078 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.267928 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.268240 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.268558 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.268859 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.269105 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.269400 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.269701 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.270014 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.270314 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.270636 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.270940 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.271236 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.271537 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.271634 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 05:07:02.272044 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.272127 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 05:07:02.272222 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.272319 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 05:07:02.272400 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.272653 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 05:07:02.272750 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.272908 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 05:07:02.273005 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.273276 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.273365 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.273576 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.273664 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.273875 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.273967 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.274190 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.274280 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.274505 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.274616 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.274829 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.274935 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.275132 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.275231 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.275432 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.275565 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.275733 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.275898 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.275989 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.276076 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.276302 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.276390 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.276622 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.276718 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803901-2-iscsi {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.276939 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.277026 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.277239 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.277327 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.277538 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.277636 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.277849 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.277938 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.278148 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.278243 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.278448 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.278537 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.278778 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.278865 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.279072 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.279292 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.279407 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.279616 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.279720 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.279906 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.280001 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.280215 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.280315 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.280530 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.280622 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.280826 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.280914 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.281124 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.281213 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.281423 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.281512 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.281722 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.281808 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.282020 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.282116 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.282316 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.282410 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.282651 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.282742 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803901-2-iscsi {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.283038 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.283174 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.283362 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.283491 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.283666 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.283805 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.283969 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.284217 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.284307 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.284526 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.284627 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.284836 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.284924 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.285157 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.285246 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.285481 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.285614 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.285791 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.285890 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.286119 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.286208 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.286440 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.286536 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.286793 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.286893 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.287109 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.287195 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.287416 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.287504 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.287718 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.287813 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.288025 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.288121 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.288334 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.288421 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.288637 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.288722 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.288942 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.289039 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.289192 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.289324 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.289499 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.289596 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.289819 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.289924 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.290143 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.290230 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.290451 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.290537 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.290727 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.290827 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.290965 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.291096 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.291285 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.291411 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.291605 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.291702 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.291912 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.292041 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.292226 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.292379 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.292538 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.292688 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.292844 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.293008 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.293149 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.293317 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.293454 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.293635 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.293758 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.293944 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.294061 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.294251 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.294379 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.294559 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.294717 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.294893 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.295039 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.295201 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.295346 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.295511 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.295665 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.295842 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.296062 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.296161 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.296314 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.296450 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.296621 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.296758 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.296958 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.297055 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.297277 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.297364 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.297582 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.297668 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.297902 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.297991 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.298221 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.298309 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.298554 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.298709 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.298878 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.298968 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.299181 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.299269 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.299499 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.299588 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.299806 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.299896 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.300107 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.300193 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.300355 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.300442 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.300655 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.300743 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.300956 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.301048 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.301271 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.301367 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.301577 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.301666 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.301879 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.301966 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.302176 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.302275 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.302473 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.302566 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.302801 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.302890 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.303100 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.303253 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.303405 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.303500 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.303709 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.303797 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.304010 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.304150 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.304314 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.304400 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.304616 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.304701 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.304919 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.305030 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.305222 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.305317 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.305539 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.305626 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.305858 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.305955 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.306157 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.306244 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.306459 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.306551 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.306786 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.306888 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.307092 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.307181 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.307395 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.307483 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.307702 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.307803 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.308004 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.308100 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.308306 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.308395 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.308606 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.308707 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.308908 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.309001 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.309206 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.309298 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.309508 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.309605 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.309812 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.309906 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.310109 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.310196 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.310409 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.310507 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.310736 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.310828 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.311044 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.311130 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.311344 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.311440 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.311644 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.311738 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.311939 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.312027 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.312243 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.312331 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.312546 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.312634 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.312849 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.312944 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.313151 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.313249 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.313451 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.313546 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.313749 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.313838 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.314568 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.314758 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.314914 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.315005 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.315221 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.315319 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.315528 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.315616 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.315834 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.315977 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.316152 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:07:02.316251 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.316476 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.316570 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.316790 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.316878 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.317109 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.317208 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.317420 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.317530 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.317739 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.317832 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.318044 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.318142 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.318360 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.318448 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.318682 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.318786 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.318997 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.319087 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.319305 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.319394 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.319623 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.319712 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.319951 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.320040 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.320259 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.320348 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.320568 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.320655 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.320882 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.320976 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.321188 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.321276 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.321494 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.321581 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.321801 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.321890 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.322100 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.322188 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.322402 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.322498 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.322732 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.322835 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.323046 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.323134 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.323354 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.323452 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.323662 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.323751 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.323964 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.324051 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.324274 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.324378 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.324577 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.324673 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.324878 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.324966 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.325178 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.325337 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.325485 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.325580 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.325806 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.325893 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.326113 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.326213 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.326428 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.326515 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.326768 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.326858 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.327071 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.327159 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.327373 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.327461 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.327693 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.327780 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.327999 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.328088 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.328299 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.328387 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.328600 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.328696 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.328900 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.328990 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.329206 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.329336 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.329515 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.329604 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.330389 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.330484 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.330739 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.330831 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.331067 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.331155 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.331376 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.331466 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.331687 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.331774 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.331997 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.332096 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.332303 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.332391 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.332611 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.332697 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.332917 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.333017 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.333220 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.333320 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.333525 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.333613 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.333827 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.333968 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.334130 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.334217 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.334435 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.334523 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.334765 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.334866 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.335071 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.335165 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.335375 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.335464 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.335677 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.335764 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.335976 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.336063 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.336281 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.336369 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.336590 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.336678 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.336901 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.337157 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.337244 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.337483 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.337580 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.337793 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.337888 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.338109 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.338197 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.338423 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.338520 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.338759 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.338849 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.339083 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.339169 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.339403 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.339492 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.339712 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.339837 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.340014 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.340108 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.340319 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.340409 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.340620 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.340709 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.341196 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.341284 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.341502 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.341597 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.341802 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.341890 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.342103 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.342190 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.342404 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.342492 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.342726 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.342829 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.343026 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.343112 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.343326 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.343415 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.343626 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.343713 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.343926 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.344027 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.344229 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.344316 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.344526 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.344612 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.344825 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.344925 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.345123 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.345213 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.345466 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.345555 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.345770 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.345867 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.346067 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.346155 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.346366 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.346461 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.346689 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.346802 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.347034 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.347122 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.347334 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.347423 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.347667 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.347764 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.347989 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.348076 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.348301 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.348388 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.348610 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.348706 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.348910 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.348999 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.349223 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.349308 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.349526 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.349628 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.349838 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.349972 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.350121 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.350217 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.350425 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.350526 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.350752 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.350851 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.351051 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.351139 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.351358 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.351454 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.351663 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.351759 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.351969 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.352057 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.352271 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.352436 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.352568 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.352657 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.352871 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.352960 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.353168 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.353269 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.353477 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.353565 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.353780 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.353869 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.354079 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.354169 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.354377 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.354501 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.354700 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.354789 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.355003 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.355091 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.355300 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.355389 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.355603 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.355691 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.355902 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.355993 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.356205 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.356291 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.356503 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.356588 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.356806 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.356896 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.357103 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.357201 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.357403 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.357489 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.357704 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.357792 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.358005 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.358155 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.358324 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.358419 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.358667 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.358769 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.358992 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.359081 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.359298 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.359395 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.359600 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.359688 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.359898 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.359994 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.360212 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.360355 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.360515 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.360684 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.360818 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.361021 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.361164 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.361388 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.361484 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.361699 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.361788 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.362000 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.362087 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.362303 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.362399 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.362620 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.362710 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.362928 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.363029 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.363306 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.363396 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.363612 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.363699 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.363913 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.364009 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.364214 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.364306 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.364514 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.364648 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.364825 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.364922 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.365129 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.365251 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.365430 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.365519 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.365731 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.365827 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.366028 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.366117 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.366347 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.366477 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.366677 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.366780 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.366989 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.367076 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.367298 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.367384 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.367604 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.367700 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.367913 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.368007 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.368228 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.368314 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.368535 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.368787 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.368875 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.369122 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.369208 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.369432 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.369529 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.369740 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.369829 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.370049 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.370172 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.370350 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.370447 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.370672 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.370764 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.370994 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.371081 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.371301 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.371391 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.371609 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.371697 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.371918 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.372012 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.372231 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.372326 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.372536 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.372630 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.372837 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.372922 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.373136 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.373224 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.373441 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.373527 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.373743 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.373836 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.374046 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.374133 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.374346 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.374434 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.374672 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.374778 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.374976 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.375063 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.375280 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.375411 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.375587 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.375685 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.375887 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.375973 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.376185 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.376271 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.376486 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.377118 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.377319 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.377414 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.377621 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.377709 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.377922 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.378017 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.378228 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.378315 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.378524 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.378631 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.378855 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.378956 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.379153 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.379249 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.379457 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.379600 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.379755 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.379845 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.380142 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.380263 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.380447 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.380541 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.380752 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.380841 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.381065 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.381152 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.381372 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.381468 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.381675 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.381772 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.381979 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.382066 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.382290 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.382376 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.382628 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.382733 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.382925 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.383034 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.383236 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.383345 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.383546 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.383642 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.383854 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.383943 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.384161 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.384249 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.384464 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.384561 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.384771 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.384859 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.385075 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.385162 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.385388 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.385478 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.385695 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.385784 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.385997 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.386083 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.386297 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.386386 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.386627 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.386716 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.386938 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.387036 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.387242 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.387361 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.387549 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.387670 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.387852 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.387973 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.388166 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.388386 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.388476 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.388698 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.388787 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.389005 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.389103 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.389330 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.389434 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.389638 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.389799 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.389943 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.390032 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.390266 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.390400 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.390616 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.390708 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.390896 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.390986 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.391204 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.391299 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.391510 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.391598 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.391811 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.391907 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.392120 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.392268 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.392984 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.393079 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.393298 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.393386 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.393602 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.393691 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.393910 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.394007 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.394213 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.394302 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.394516 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.394634 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.394844 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.394950 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.395149 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.395237 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.395450 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.395584 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.395751 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.395853 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.396051 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.396140 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.396352 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.396442 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.396653 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.396749 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.396972 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.397059 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.397277 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.397364 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.397576 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.397677 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.397879 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.397967 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.398177 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.398264 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.398497 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.398612 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.398827 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.398929 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.399130 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.399217 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.399430 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.399519 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.399753 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.399840 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.400053 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.400141 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.400370 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.400501 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.400679 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.400766 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.400989 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.401078 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.401295 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.401390 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.401595 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.401681 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.401901 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.401986 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.402210 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.402297 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.402509 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.402644 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.402837 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.402934 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.403136 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.403223 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.403457 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.403543 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.403765 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.403862 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.404083 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.404170 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.404400 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.404485 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.404722 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.404819 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.405025 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.405112 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.405334 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.405420 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.405660 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.405755 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.405974 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.406070 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.406285 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.406373 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.406615 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.406718 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.406927 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.407013 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.407234 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.407322 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.407541 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.407640 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.407866 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.408001 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.408166 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.408255 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.408467 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.408557 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.408770 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.408856 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.409070 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.409166 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.409369 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.409460 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.409667 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.409764 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.409986 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.410083 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.410284 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.410370 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.410611 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.410705 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.410913 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.411011 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.411217 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.411303 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.411518 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.411605 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.411816 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.411945 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.412153 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.412241 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.412453 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.412542 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.412785 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.412882 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.413102 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.413190 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.413423 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.413517 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.413746 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.413841 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.414054 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.414155 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.414357 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.414443 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.414761 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.414854 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.415080 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.415179 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.415393 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.415481 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.415702 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.415797 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.416009 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.416097 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.416314 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.416431 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.416622 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.416711 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.416930 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.417074 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.417241 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.417328 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.417548 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.417643 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.417853 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.417942 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.418176 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.418364 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.418481 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.418711 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.418883 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.419025 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.419231 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.419320 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.419543 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.419631 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.419851 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.419948 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.420227 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.420322 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.420534 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.420632 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.420841 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.420938 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.421147 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.421235 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.421455 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.421574 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.421779 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.421868 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.422084 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.422187 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.422398 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.422496 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.422732 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.422822 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.423068 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.423155 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.423379 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.423521 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.423719 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.423812 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.424035 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.424131 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.424342 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.424471 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.424668 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.424761 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.424985 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.425073 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.425297 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.425393 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.425612 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.425726 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.425927 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.426029 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.426239 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.426328 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.426550 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.426711 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.426884 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.427016 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.427204 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.427295 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.427515 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.427603 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.427821 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.427921 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.428131 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.428220 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.428442 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.428531 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.428746 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.428841 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.429072 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.429160 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.429378 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.429466 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.429691 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.429809 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.430000 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.430088 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.430306 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.430393 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.430630 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.430843 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.430931 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.431157 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.431254 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.431490 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.431588 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.431814 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.431926 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.432137 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.432226 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.432451 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.432548 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.432763 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.432859 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.433074 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.433160 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.433375 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.433463 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.433676 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.433764 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.433982 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.434070 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.434286 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.434377 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.434594 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.434682 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.434926 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.435014 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.435233 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.435359 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.435534 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.435630 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.435850 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.435939 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.436156 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.436253 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.436483 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.436684 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.436816 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.437035 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.437131 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.437358 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.437453 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.437687 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.437776 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.438015 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.438105 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.438330 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.438418 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.438657 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.438749 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.438967 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.439558 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.439790 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.439882 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.440096 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.440184 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.440405 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.440495 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.440710 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.440797 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.441011 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.441098 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.441311 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.441407 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.441610 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.441705 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.441914 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.442011 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.442215 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.442304 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.442522 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.442650 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.442845 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.442949 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.443148 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.443236 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.443458 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.443546 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.443759 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.443855 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.444061 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.444150 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.444369 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.444456 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.444669 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.444767 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.444970 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.445059 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.445270 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.445359 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.445572 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.445662 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.445882 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.445970 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.446184 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.446272 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.446492 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.446600 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.446838 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.446926 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.447149 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.447238 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.447454 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.447544 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.447768 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.447865 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.448072 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.448160 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.448395 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.448486 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.448698 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.448786 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.449000 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.449087 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.449314 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.449403 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.449623 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.449711 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.449946 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.450138 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.450258 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.450470 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.450559 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.450810 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.450936 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.451126 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.451253 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.451440 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.451760 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.451847 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.452073 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.452170 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.452386 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.452477 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.452699 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.452787 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.453011 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.453107 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.453322 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.453411 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.453642 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.453729 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.453947 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.454038 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.454268 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.454355 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.454647 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.454827 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.455517 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.455610 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.455836 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.455962 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.456220 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.456423 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.456544 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.456885 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.456973 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.457297 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.457385 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.457607 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.457931 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.458111 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.458251 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.458592 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.458682 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.458911 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.459099 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.459225 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.459542 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.459630 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.459862 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.460089 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.460178 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.460479 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.460601 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.460796 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.461103 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.461200 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.461431 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.461636 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.461773 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.462096 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.462192 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.462410 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.462605 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.462748 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.463063 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.463151 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.463549 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.463645 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.463892 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.464039 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.464231 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.464559 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.464647 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.464885 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.465127 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.465216 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.465504 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.465600 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.466097 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.466332 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.466420 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.466728 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.467013 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.467115 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.467342 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.467498 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.467652 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.467975 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.468063 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.468286 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.468477 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.468576 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.468899 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.468986 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.469211 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.469445 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.469744 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.469961 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.470091 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.470438 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.470545 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.470789 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.471015 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.471104 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.471427 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.471515 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.471738 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.471944 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.472065 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.472376 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.472465 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.472685 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.472874 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.473003 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.473316 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.473404 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.473629 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.473893 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.473990 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.474233 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.474380 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.474543 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.474871 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.474973 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.475185 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.475377 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.475473 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.475803 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.475891 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.476112 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.476381 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.476471 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.476711 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.476927 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.477015 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.477314 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.477490 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.477620 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.477924 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.478042 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.478227 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.478541 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.478650 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.478868 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.479178 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.479277 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.479482 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.479747 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.479847 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.480086 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.480310 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.480399 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.480700 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.480878 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.481024 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.481331 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.481418 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.481635 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.481952 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.482041 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.482263 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.482510 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.482624 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.482908 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.483119 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.483210 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.483557 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.483698 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.483872 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.484194 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.484524 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.484691 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.484857 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.485175 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.485262 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.485503 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.485818 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.485983 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.486172 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.486451 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.486650 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.486833 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.487147 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.487441 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.487531 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.487785 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.487993 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.488101 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.488393 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.488559 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.488703 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.489013 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.489111 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.489372 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.489652 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.489750 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.489975 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.490200 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.490299 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.490614 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.490801 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.490936 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.491256 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.491346 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.491573 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.491847 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.491937 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.492245 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.492374 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.492569 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.492889 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.492980 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.493317 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.493415 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.493661 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.493887 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.493998 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.494320 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.494410 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.494723 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.494944 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.495046 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.495297 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.495387 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.495624 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.495719 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.495949 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.496093 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.496272 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.496372 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.496588 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.496684 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.496904 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.497001 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.497219 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.497316 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.497520 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93211) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 05:07:02.497609 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.497840 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.498172 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.498490 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.498825 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.499261 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.499578 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.499903 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.500226 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.500542 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.500873 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.501216 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.501548 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.502387 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.502719 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.503029 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.503336 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.503655 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.504002 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.504355 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.504677 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.505004 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.505325 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.505643 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.505956 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.506269 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.506606 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.506991 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.507542 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.508059 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.508583 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.509042 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.509442 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.509765 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.510097 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.510414 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.510838 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.511161 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.511502 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.511823 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.512152 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.512468 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.512795 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.513109 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.513434 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.513766 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.514085 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.514397 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.514760 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.515075 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.515389 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.515702 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.516015 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.516334 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.516645 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.517129 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.518157 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.518489 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.518835 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.519154 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.519484 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.519812 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.520130 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.520466 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.520906 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.521109 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.521411 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.521724 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.522037 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.522299 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG oslo_db.sqlalchemy.engines [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:07:02.522424 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.522712 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.523342 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.523342 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.523659 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.524112 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.524653 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.525249 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.525802 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:07:02.526208 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93210) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 05:07:02.560201 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_db.sqlalchemy.engines [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:07:02.605165 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.context [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e(cell1) {{(pid=93211) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 05:07:02.609449 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG oslo_concurrency.lockutils [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:07:02.611572 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG oslo_concurrency.lockutils [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:07:02.612374 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG oslo_concurrency.lockutils [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:07:02.614311 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG oslo_concurrency.lockutils [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93211) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:07:02.624565 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG oslo_db.sqlalchemy.engines [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:07:02.625389 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG oslo_db.sqlalchemy.engines [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:07:02.641804 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.context [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e(cell1) {{(pid=93210) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 05:07:02.646557 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:07:02.648181 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:07:02.648993 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:07:02.650966 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:07:02.663770 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_db.sqlalchemy.engines [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:07:02.666337 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_db.sqlalchemy.engines [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:07:02.984124 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG oslo_db.sqlalchemy.engines [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93211) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:07:03.026604 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_db.sqlalchemy.engines [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93210) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:07:03.390584 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: WARNING keystonemiddleware.auth_token [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 05:07:03.397114 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: WARNING keystonemiddleware.auth_token [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 05:07:03.418951 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: WARNING keystonemiddleware.auth_token [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 05:07:03.425897 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: WARNING keystonemiddleware.auth_token [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 05:07:03.741790 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: WARNING keystonemiddleware.auth_token [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 05:07:03.746965 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: WARNING keystonemiddleware.auth_token [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 05:07:03.752807 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635bc2a69c0 pid: 93211 (default app) Aug 10 05:07:03.754934 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:07:03.756139 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001796 Aug 10 05:07:03.756551 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 789 bytes} [Tue Aug 10 05:07:03 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:07:03.773642 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: WARNING keystonemiddleware.auth_token [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 05:07:03.778895 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: WARNING keystonemiddleware.auth_token [None req-61ab52c8-26e1-4516-b546-065cf2fe4b6c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 05:07:03.784036 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5635bc2a69c0 pid: 93210 (default app) Aug 10 05:08:25.611449 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:25.612568 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Aug 10 05:08:25.613213 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:26.023607 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-e42c90e2-37e6-4f12-8bb2-9d79011a35a4 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:26.053293 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-e42c90e2-37e6-4f12-8bb2-9d79011a35a4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.432838 Aug 10 05:08:26.054214 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Aug 10 05:08:25 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:08:28.251850 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:28.252858 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-33276255-1c7c-4037-8a82-d78df1367786 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 10 05:08:28.253296 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:28.314682 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-fffc827d-1c07-4da1-a3bd-855020a3872d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "disk": 1, "vcpus": 1, "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:28.332391 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:08:28.332391 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: warnings.warn(msg) Aug 10 05:08:28.484858 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-fffc827d-1c07-4da1-a3bd-855020a3872d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.224055 Aug 10 05:08:28.493116 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:28 2021] POST /compute/v2.1/flavors => generated 407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:08:28.708543 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-3d46233e-60bb-4f6e-b74b-f7e6056127cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:28.710899 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:08:28.710899 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: warnings.warn(msg) Aug 10 05:08:28.824572 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-3d46233e-60bb-4f6e-b74b-f7e6056127cd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.329907 Aug 10 05:08:28.829524 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Aug 10 05:08:28 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:08:31.007234 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-fffc827d-1c07-4da1-a3bd-855020a3872d admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:31.008285 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-fffc827d-1c07-4da1-a3bd-855020a3872d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 10 05:08:31.008688 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:31.119958 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-c16933e4-a8be-40fc-86e3-1a57060185b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "vcpus": 1}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:31.146882 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:08:31.146882 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: warnings.warn(msg) Aug 10 05:08:31.264161 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-c16933e4-a8be-40fc-86e3-1a57060185b2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.248883 Aug 10 05:08:31.264993 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:08:31.278276 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-5c34a615-8c2d-48ca-a854-6f82a8fb4fbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:31.280951 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:08:31.280951 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: warnings.warn(msg) Aug 10 05:08:31.399845 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-5c34a615-8c2d-48ca-a854-6f82a8fb4fbb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125097 Aug 10 05:08:31.402880 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Aug 10 05:08:31 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:08:33.601824 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-c16933e4-a8be-40fc-86e3-1a57060185b2 admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:33.602870 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-c16933e4-a8be-40fc-86e3-1a57060185b2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 10 05:08:33.603280 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:33.664875 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-7cebac04-8030-4e9f-8109-8ffd0b335105 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:33.737011 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-7cebac04-8030-4e9f-8109-8ffd0b335105 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.125481 Aug 10 05:08:33.737880 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:33 2021] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:08:33.750120 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-5b78d25b-1cdb-41b8-a8e4-e71ea44d787a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:33.844395 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-5b78d25b-1cdb-41b8-a8e4-e71ea44d787a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098088 Aug 10 05:08:33.845133 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Aug 10 05:08:33 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:08:36.059917 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-7cebac04-8030-4e9f-8109-8ffd0b335105 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:36.060922 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-7cebac04-8030-4e9f-8109-8ffd0b335105 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 10 05:08:36.061526 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:36.118269 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-72d60863-05c1-4aa5-a4cb-f44585fb88ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "id": "d3", "rxtx_factor": 1.0}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:36.170106 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-72d60863-05c1-4aa5-a4cb-f44585fb88ef admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.102457 Aug 10 05:08:36.170695 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:08:36.184224 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-19ca03ad-2547-4f31-8dc4-97cc7e4288b1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:36.242678 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-19ca03ad-2547-4f31-8dc4-97cc7e4288b1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062138 Aug 10 05:08:36.243193 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Aug 10 05:08:36 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:08:38.416200 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-72d60863-05c1-4aa5-a4cb-f44585fb88ef admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:38.417211 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-72d60863-05c1-4aa5-a4cb-f44585fb88ef admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 10 05:08:38.417613 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:08:38.484366 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-950e05d0-d54b-4f81-acb5-49003b4f727a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:38.577029 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-950e05d0-d54b-4f81-acb5-49003b4f727a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152396 Aug 10 05:08:38.577843 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:08:38.589764 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-7921d14a-ba57-4eb5-9dc2-159b9bd2b62a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:38.677762 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-7921d14a-ba57-4eb5-9dc2-159b9bd2b62a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091558 Aug 10 05:08:38.678343 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Tue Aug 10 05:08:38 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:08:40.845453 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-950e05d0-d54b-4f81-acb5-49003b4f727a admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:40.846461 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-950e05d0-d54b-4f81-acb5-49003b4f727a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 10 05:08:40.846914 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:40.907526 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-77e9ef2e-1405-46ec-aaa6-8207f299caf4 admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:40.930762 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-77e9ef2e-1405-46ec-aaa6-8207f299caf4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077422 Aug 10 05:08:40.931494 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Aug 10 05:08:40 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:08:43.157674 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-950e05d0-d54b-4f81-acb5-49003b4f727a admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:43.158713 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-950e05d0-d54b-4f81-acb5-49003b4f727a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 10 05:08:43.159115 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:43.232440 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-e859ed93-1a3c-4eab-aeb3-53266605ab9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "swap": 0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:43.366106 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-e859ed93-1a3c-4eab-aeb3-53266605ab9c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.200151 Aug 10 05:08:43.366963 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:43 2021] POST /compute/v2.1/flavors => generated 402 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:08:43.379223 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-6d71b1c1-5c5e-4e8f-b602-4060855c8075 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:43.483703 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-6d71b1c1-5c5e-4e8f-b602-4060855c8075 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108215 Aug 10 05:08:43.484303 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Aug 10 05:08:43 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:08:45.616026 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-e859ed93-1a3c-4eab-aeb3-53266605ab9c admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:45.617078 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-e859ed93-1a3c-4eab-aeb3-53266605ab9c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 10 05:08:45.617559 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:45.681219 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-9d51a1ab-9020-4da7-ad8c-d6b05fe14d9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:45.775103 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-9d51a1ab-9020-4da7-ad8c-d6b05fe14d9c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.150872 Aug 10 05:08:45.775847 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:08:45.789012 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-73220bbe-4663-479a-8557-15a978bc25ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:45.860866 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-73220bbe-4663-479a-8557-15a978bc25ef admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075758 Aug 10 05:08:45.861448 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Aug 10 05:08:45 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:08:48.007668 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-9d51a1ab-9020-4da7-ad8c-d6b05fe14d9c admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:48.008689 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-9d51a1ab-9020-4da7-ad8c-d6b05fe14d9c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 10 05:08:48.009090 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:48.067264 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-20a9a037-a8a0-472d-9a21-015bc183dc9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:48.136955 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-20a9a037-a8a0-472d-9a21-015bc183dc9d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.121088 Aug 10 05:08:48.137728 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:48 2021] POST /compute/v2.1/flavors => generated 406 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:08:48.150757 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-275e06d3-bd7a-428a-afc1-78ffd36cd616 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:48.225777 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-275e06d3-bd7a-428a-afc1-78ffd36cd616 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079303 Aug 10 05:08:48.226283 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Aug 10 05:08:48 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:08:50.384556 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-20a9a037-a8a0-472d-9a21-015bc183dc9d admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:50.386193 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-20a9a037-a8a0-472d-9a21-015bc183dc9d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Aug 10 05:08:50.388326 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:50 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:50.448728 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-c7d57254-6535-45f8-aafe-75ce45bc50de admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "ram": 8192, "swap": 0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:50.536013 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-c7d57254-6535-45f8-aafe-75ce45bc50de admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142756 Aug 10 05:08:50.536673 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:08:50.550621 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-660be37b-3421-44ce-98fc-a62c37e0e6a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:50.627065 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-660be37b-3421-44ce-98fc-a62c37e0e6a5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079972 Aug 10 05:08:50.627561 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Aug 10 05:08:50 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:08:52.808762 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-c7d57254-6535-45f8-aafe-75ce45bc50de admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:08:52.809775 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-c7d57254-6535-45f8-aafe-75ce45bc50de admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 10 05:08:52.810173 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:08:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:08:52.871629 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-7d49cd79-6770-4ba6-9cd4-18ee9c3df0dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "id": "5"}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:52.948700 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-7d49cd79-6770-4ba6-9cd4-18ee9c3df0dd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.132085 Aug 10 05:08:52.949406 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Tue Aug 10 05:08:52 2021] POST /compute/v2.1/flavors => generated 408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:08:52.962515 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-7a1bee50-1e49-44d1-9dae-f220cd3a7000 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:08:53.045378 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-7a1bee50-1e49-44d1-9dae-f220cd3a7000 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086738 Aug 10 05:08:53.046638 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Tue Aug 10 05:08:52 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:09:32.407632 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-7d49cd79-6770-4ba6-9cd4-18ee9c3df0dd admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:32.408632 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-7d49cd79-6770-4ba6-9cd4-18ee9c3df0dd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 10 05:09:32.409024 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:09:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:32.465868 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d8b46941-f3fd-4347-b497-9a8a7233badd admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:32.482424 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d8b46941-f3fd-4347-b497-9a8a7233badd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067202 Aug 10 05:09:32.483763 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Aug 10 05:09:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:09:33.937115 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-7d49cd79-6770-4ba6-9cd4-18ee9c3df0dd admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:33.938104 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-7d49cd79-6770-4ba6-9cd4-18ee9c3df0dd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002007 Aug 10 05:09:33.938500 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:09:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:34.124845 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-8c6737ab-135d-477e-bd76-a0f811e9f35a admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:34.130377 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.wsgi [None req-8c6737ab-135d-477e-bd76-a0f811e9f35a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 05:09:34.130979 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-8c6737ab-135d-477e-bd76-a0f811e9f35a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:09:34.131766 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-8c6737ab-135d-477e-bd76-a0f811e9f35a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.058255 Aug 10 05:09:34.132271 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1191 bytes} [Tue Aug 10 05:09:34 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 05:09:34.142327 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-33333095-1cf7-4c3e-a2df-712d4887b21e admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:34.163093 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-33333095-1cf7-4c3e-a2df-712d4887b21e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024657 Aug 10 05:09:34.163572 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1211 bytes} [Tue Aug 10 05:09:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:09:34.173404 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-22b98923-99cd-4374-be69-0ff9aa8a32c8 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:34.194373 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-22b98923-99cd-4374-be69-0ff9aa8a32c8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024461 Aug 10 05:09:34.194937 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1211 bytes} [Tue Aug 10 05:09:34 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:09:34.205098 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-7c0fb3e8-3a39-432f-88fd-55b1d00ddac1 admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:34.210324 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.wsgi [None req-7c0fb3e8-3a39-432f-88fd-55b1d00ddac1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 05:09:34.210929 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-7c0fb3e8-3a39-432f-88fd-55b1d00ddac1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:09:34.211716 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-7c0fb3e8-3a39-432f-88fd-55b1d00ddac1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010720 Aug 10 05:09:34.212197 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1191 bytes} [Tue Aug 10 05:09:34 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:35.544032 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-22b98923-99cd-4374-be69-0ff9aa8a32c8 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:35.545040 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-22b98923-99cd-4374-be69-0ff9aa8a32c8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 10 05:09:35.546031 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:09:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:35.737967 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-0b8e7d49-307a-4861-9242-fe0cfa87bc6c admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:35.743152 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.wsgi [None req-0b8e7d49-307a-4861-9242-fe0cfa87bc6c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 05:09:35.743715 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-0b8e7d49-307a-4861-9242-fe0cfa87bc6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:09:35.744505 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-0b8e7d49-307a-4861-9242-fe0cfa87bc6c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.058885 Aug 10 05:09:35.745005 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1191 bytes} [Tue Aug 10 05:09:35 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:35.754712 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-96c40058-174e-465a-a8f5-2bcec022a7ad admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:35.769264 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-96c40058-174e-465a-a8f5-2bcec022a7ad admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018119 Aug 10 05:09:35.769775 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1211 bytes} [Tue Aug 10 05:09:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:09:35.780147 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-1d28f2ca-52f5-4d70-ba3c-0bdd742deadc admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:35.793435 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-1d28f2ca-52f5-4d70-ba3c-0bdd742deadc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017327 Aug 10 05:09:35.793972 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1211 bytes} [Tue Aug 10 05:09:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:09:35.804528 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-26a6b49f-0671-4569-9852-e0a792ed35a7 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:35.809746 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.wsgi [None req-26a6b49f-0671-4569-9852-e0a792ed35a7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 05:09:35.810295 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-26a6b49f-0671-4569-9852-e0a792ed35a7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:09:35.811112 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-26a6b49f-0671-4569-9852-e0a792ed35a7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010101 Aug 10 05:09:35.811587 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1191 bytes} [Tue Aug 10 05:09:35 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 05:09:37.143516 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-1d28f2ca-52f5-4d70-ba3c-0bdd742deadc admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:37.144517 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-1d28f2ca-52f5-4d70-ba3c-0bdd742deadc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 10 05:09:37.144908 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:09:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:37.332407 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d17beed2-65f0-4e4e-ac49-a4e6bc36d70f admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:37.338111 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.wsgi [None req-d17beed2-65f0-4e4e-ac49-a4e6bc36d70f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 05:09:37.338696 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d17beed2-65f0-4e4e-ac49-a4e6bc36d70f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93210) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:09:37.339511 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d17beed2-65f0-4e4e-ac49-a4e6bc36d70f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.057822 Aug 10 05:09:37.340010 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1194 bytes} [Tue Aug 10 05:09:37 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:37.349884 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-94315ce6-7d35-4abc-98e6-c326726be53f admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:37.365416 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-94315ce6-7d35-4abc-98e6-c326726be53f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018901 Aug 10 05:09:37.365884 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1211 bytes} [Tue Aug 10 05:09:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:09:37.376523 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:37.390281 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017841 Aug 10 05:09:37.390902 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1211 bytes} [Tue Aug 10 05:09:37 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:09:37.400463 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-cfa2fe7c-0916-49ef-bd24-68387178e8bf admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:37.405598 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.wsgi [None req-cfa2fe7c-0916-49ef-bd24-68387178e8bf admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 05:09:37.406150 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-cfa2fe7c-0916-49ef-bd24-68387178e8bf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93211) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:09:37.407362 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-cfa2fe7c-0916-49ef-bd24-68387178e8bf admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.009968 Aug 10 05:09:37.407450 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1194 bytes} [Tue Aug 10 05:09:37 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:38.746074 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:38.747149 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 10 05:09:38.747538 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:09:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:38.935839 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-23a937ae-b26d-4c28-867d-d9ed72feb2b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:09:39.004896 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-23a937ae-b26d-4c28-867d-d9ed72feb2b7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.119111 Aug 10 05:09:39.005454 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1236 bytes} [Tue Aug 10 05:09:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:09:40.324392 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:40.325390 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 10 05:09:40.325782 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:09:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:40.514475 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-460e81ed-64d7-4aaf-9b24-90914df572ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:09:40.588185 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-460e81ed-64d7-4aaf-9b24-90914df572ad admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.125083 Aug 10 05:09:40.588661 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1236 bytes} [Tue Aug 10 05:09:40 2021] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:09:41.915390 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:41.916415 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 10 05:09:41.916897 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:09:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:42.104331 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-188686d8-6cff-47c1-8197-55b4b2c6b63a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:09:42.171478 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-188686d8-6cff-47c1-8197-55b4b2c6b63a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.117388 Aug 10 05:09:42.171952 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1236 bytes} [Tue Aug 10 05:09:42 2021] POST /compute/v2.1/flavors => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:09:43.512393 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:43.513390 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 10 05:09:43.514367 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:09:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:43.702898 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-e1f9e485-b9e8-46d5-80d8-4ea7c9076d4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:09:43.776453 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-e1f9e485-b9e8-46d5-80d8-4ea7c9076d4d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.125278 Aug 10 05:09:43.777006 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1236 bytes} [Tue Aug 10 05:09:43 2021] POST /compute/v2.1/flavors => generated 409 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:09:45.104430 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:45.105427 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 10 05:09:45.105820 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:09:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:09:45.292360 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-b569152a-67b4-4471-bb5c-526750126a05 admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:09:45.310963 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-b569152a-67b4-4471-bb5c-526750126a05 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.070562 Aug 10 05:09:45.311499 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1203 bytes} [Tue Aug 10 05:09:45 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:10:32.894838 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:10:32.895860 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-d98b357b-e17c-4afa-a1a2-3a9545728baf admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 10 05:10:32.896253 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Tue Aug 10 05:10:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:10:32.953264 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-d4adf88f-ef64-4cb2-91b7-d27bb5c73078 admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:10:32.972712 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-d4adf88f-ef64-4cb2-91b7-d27bb5c73078 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070029 Aug 10 05:10:32.973231 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Tue Aug 10 05:10:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:10:32.995143 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-78f59f18-5dde-42a9-914d-95ab8c713010 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:10:33.002663 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-78f59f18-5dde-42a9-914d-95ab8c713010 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011004 Aug 10 05:10:33.003179 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Tue Aug 10 05:10:32 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:10:33.014703 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-a8f0e974-5800-4504-914a-6178624abaff admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:10:33.022107 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-a8f0e974-5800-4504-914a-6178624abaff admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011291 Aug 10 05:10:33.022636 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Tue Aug 10 05:10:33 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:10:33.034313 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-6923a642-1728-48f4-81d1-0e5d695fe4a1 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:10:33.041717 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-6923a642-1728-48f4-81d1-0e5d695fe4a1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010734 Aug 10 05:10:33.042226 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Tue Aug 10 05:10:33 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:10:33.052967 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-e41e145f-658d-4f5b-b209-080934251d6f admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:10:33.060172 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-e41e145f-658d-4f5b-b209-080934251d6f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010479 Aug 10 05:10:33.060670 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Tue Aug 10 05:10:33 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:12:19.037204 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-8528b8fc-78c6-4add-b6c6-67f083f6e162 tempest-verify_tempest_config-910759658 tempest-verify_tempest_config-910759658-project] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:12:19.039203 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-8528b8fc-78c6-4add-b6c6-67f083f6e162 tempest-verify_tempest_config-910759658 tempest-verify_tempest_config-910759658-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105382 Aug 10 05:12:19.039740 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1134 bytes} [Tue Aug 10 05:12:18 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:13:50.103597 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-e41e145f-658d-4f5b-b209-080934251d6f admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:13:50.104877 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-e41e145f-658d-4f5b-b209-080934251d6f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 10 05:13:50.105276 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:13:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:13:50.351894 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-25c6320c-aaff-4908-9ebc-413d67df29b8 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:13:50.353572 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:13:50.353572 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: warnings.warn(msg) Aug 10 05:13:50.355422 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-25c6320c-aaff-4908-9ebc-413d67df29b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:13:50.355864 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-25c6320c-aaff-4908-9ebc-413d67df29b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:13:50.356652 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-25c6320c-aaff-4908-9ebc-413d67df29b8 admin admin] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:13:50.357107 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-25c6320c-aaff-4908-9ebc-413d67df29b8 admin admin] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:13:50.395029 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-25c6320c-aaff-4908-9ebc-413d67df29b8 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.152775 Aug 10 05:13:50.395587 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 35/71] 10.222.0.16 () {60 vars in 1194 bytes} [Tue Aug 10 05:13:50 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:13:51.728397 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: DEBUG nova.api.openstack.wsgi [None req-e41e145f-658d-4f5b-b209-080934251d6f admin admin] Calling method '>' {{(pid=93211) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:13:51.729642 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: INFO nova.api.openstack.requestlog [None req-e41e145f-658d-4f5b-b209-080934251d6f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 10 05:13:51.730088 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: [pid: 93211|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1075 bytes} [Tue Aug 10 05:13:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:13:51.923283 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG nova.api.openstack.wsgi [None req-4a08fe6d-e567-488d-95f6-20f2a88be503 admin admin] Calling method '>' {{(pid=93210) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:13:51.924430 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:13:51.924430 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: warnings.warn(msg) Aug 10 05:13:51.925923 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-4a08fe6d-e567-488d-95f6-20f2a88be503 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:13:51.926359 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-4a08fe6d-e567-488d-95f6-20f2a88be503 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:13:51.927187 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-4a08fe6d-e567-488d-95f6-20f2a88be503 admin admin] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:13:51.927610 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: DEBUG oslo_concurrency.lockutils [None req-4a08fe6d-e567-488d-95f6-20f2a88be503 admin admin] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93210) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:13:51.951773 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: INFO nova.api.openstack.requestlog [None req-4a08fe6d-e567-488d-95f6-20f2a88be503 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.079624 Aug 10 05:13:51.952328 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: [pid: 93210|app: 0|req: 36/73] 10.222.0.16 () {60 vars in 1194 bytes} [Tue Aug 10 05:13:51 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:14:47.891995 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: Tue Aug 10 05:14:47 2021 - graceful shutdown triggered... Aug 10 05:14:47.891773 dv-cinder-803901-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 05:14:47.892932 dv-cinder-803901-2-iscsi devstack@n-api.service[93211]: Gracefully killing worker 2 (pid: 93211)... Aug 10 05:14:47.893415 dv-cinder-803901-2-iscsi devstack@n-api.service[93210]: Gracefully killing worker 1 (pid: 93210)... Aug 10 05:14:48.892832 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: worker 1 buried after 1 seconds Aug 10 05:14:48.892832 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: worker 2 buried after 1 seconds Aug 10 05:14:48.892832 dv-cinder-803901-2-iscsi devstack@n-api.service[93209]: goodbye to uWSGI. Aug 10 05:14:48.894376 dv-cinder-803901-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 05:14:48.894961 dv-cinder-803901-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 05:14:48.897815 dv-cinder-803901-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 05:14:48.907583 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 10 05:14:48 2021] *** Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: nodename: dv-cinder-803901-2-iscsi Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: machine: x86_64 Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: clock source: unix Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: pcre jit disabled Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: detected number of CPU cores: 4 Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: current working directory: / Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: detected binary path: /usr/bin/uwsgi-core Aug 10 05:14:48.909503 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: your processes number limit is 47680 Aug 10 05:14:48.910213 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: your memory page size is 4096 bytes Aug 10 05:14:48.910213 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: detected max file descriptor number: 2048 Aug 10 05:14:48.910213 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: lock engine: pthread robust mutexes Aug 10 05:14:48.910213 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: thunder lock: enabled Aug 10 05:14:48.910213 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 05:14:48.910213 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 10 05:14:48.954135 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: Python main interpreter initialized at 0x561d0a1419c0 Aug 10 05:14:48.954135 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: python threads support enabled Aug 10 05:14:48.954135 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: your server socket listen backlog is limited to 100 connections Aug 10 05:14:48.954135 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: your mercy for graceful operations on workers is 90 seconds Aug 10 05:14:48.954550 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 05:14:48.954654 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: *** Operational MODE: preforking *** Aug 10 05:14:48.954868 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: *** uWSGI is running in multiple interpreter mode *** Aug 10 05:14:48.954868 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: spawned uWSGI master process (pid: 108124) Aug 10 05:14:48.955082 dv-cinder-803901-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 05:14:48.958615 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: spawned uWSGI worker 1 (pid: 108136, cores: 1) Aug 10 05:14:48.958615 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: spawned uWSGI worker 2 (pid: 108137, cores: 1) Aug 10 05:14:48.958615 dv-cinder-803901-2-iscsi devstack@n-api.service[108124]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 05:14:50.767941 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 05:14:50.767941 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: from cryptography.utils import int_from_bytes Aug 10 05:14:50.768638 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 05:14:50.768638 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: from cryptography.utils import int_from_bytes Aug 10 05:14:50.773058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 05:14:50.773058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: from cryptography.utils import int_from_bytes Aug 10 05:14:50.773561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 05:14:50.773561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: from cryptography.utils import int_from_bytes Aug 10 05:14:53.244008 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 05:14:53.244541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 05:14:53.245330 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 05:14:53.245623 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 05:14:53.245877 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 05:14:53.246258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.246603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.246920 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.247241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.247572 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.247924 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.248216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.248509 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.248830 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.249092 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.249402 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.249726 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803901-2-iscsi {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.250044 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.250346 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.250690 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.251003 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.251303 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.251620 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.251921 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.252418 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.253140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.253447 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.253850 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.254212 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.254523 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.254846 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.255166 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.255474 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.255804 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.256123 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.256506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803901-2-iscsi {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.256823 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.257133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.257455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.257879 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.258191 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.258490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.258837 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.259163 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.259474 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.259800 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.260119 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.260986 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.261306 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.261605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.261912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.262221 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.262539 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.262871 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.263177 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.263425 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.263732 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.264057 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.264374 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.264694 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.264945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.265194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.265507 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.265681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 05:14:53.266190 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.266338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 05:14:53.266490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.266675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 05:14:53.266832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.266832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.267125 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 05:14:53.267125 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 05:14:53.267395 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.267395 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.267704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.267861 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.268014 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.268165 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.268309 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.268459 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.268602 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.268762 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.268918 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.269060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.269208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.269360 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.269539 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.269709 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.269867 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.270015 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.270182 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.270336 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.270493 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.271123 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.271295 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.271444 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.271598 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-803901-2-iscsi {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.271742 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.271900 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.272060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.272452 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.272612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.272755 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.272910 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.273065 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.273305 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.273461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.273616 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.273758 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.273907 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.274082 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.274323 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.274323 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.274657 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.274847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.275007 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.275156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.275299 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.275446 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.275601 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.275751 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.275908 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.276057 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.276217 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.276365 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.276515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.276674 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.276828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.276978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.277121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.277262 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.277403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.277567 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.277720 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.277862 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.277862 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.278148 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-803901-2-iscsi {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.278291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.278447 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.278623 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.278783 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.278927 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.279074 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.279225 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.279366 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.279638 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.279801 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.279946 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.279946 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.280250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.280393 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.280545 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.280694 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.280856 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.281355 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.281519 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.281669 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.281819 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.281963 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.282112 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.282280 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.282666 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.282819 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.282975 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.283117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.283259 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.283499 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.283646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.283793 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.283944 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.284086 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.284235 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.284482 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.284638 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.284810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.284970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.285121 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.285263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.285403 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.285550 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.285701 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.285844 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.285996 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.286147 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.286301 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.286450 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.286680 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.286838 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.286990 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.287142 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.287295 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.287452 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.287607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.287756 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.287899 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.288051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.288205 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.288382 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.288632 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.288802 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.288956 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.289106 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.289250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.289250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.289250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.289670 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.289820 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.289970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.290120 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.290272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.290415 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.290599 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.290759 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.290910 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.291081 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.291514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.291678 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.291823 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.291974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.292132 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.292282 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.292435 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.292810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.292968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.293123 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.293277 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.293429 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.293664 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.293820 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.293964 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.294114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.294266 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.294408 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.294738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.294890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.295034 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.295185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.295341 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.295492 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.295646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.295795 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.295937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.298514 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.298710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.298861 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.299019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.299163 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.299305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.299462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.299625 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.299777 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.299921 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.300062 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.300211 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.300363 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.300513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.300661 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.300805 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.300954 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.301104 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.301255 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.301728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.301892 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.302044 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.302194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.302347 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.302491 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.302656 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.303050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.303210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.303361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.303521 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.303791 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.303951 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.304094 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.304256 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.304406 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.304558 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.304726 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.304965 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.305114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.305265 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.305408 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.305559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.305708 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.305851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.305994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.306147 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.306302 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.306453 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.306647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.306798 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.306941 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.307083 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.307887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.308035 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.308189 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.308342 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.308484 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.308634 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.308788 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.308930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.309071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.309223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.309366 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.309515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.309666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.309816 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.310001 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.310226 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.310379 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.310533 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.310718 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.310874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.311016 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.311183 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.311345 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.311515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.311931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.312091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.312243 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.312398 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.312558 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.312710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.313211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.313377 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.313533 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.313691 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.313860 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.314082 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.314230 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.314372 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.314521 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.314723 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.314878 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.315126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.315289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.315443 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.315612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.315763 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.315912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.316056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.316197 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.316338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.316494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.316644 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.316797 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.316940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.317080 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.317228 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.317384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.317545 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 05:14:53.317688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.317837 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.317978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.318126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.318282 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.318424 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.318567 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.318742 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.318895 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.319047 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.319202 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.319354 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.319506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.319650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.319799 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.319955 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.320105 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.320249 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.320398 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.320548 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.320698 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.320850 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.320993 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.321134 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.321285 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.321434 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.321585 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.321757 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.322146 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.322289 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.322437 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.322650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.323680 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.323848 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.323994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.323994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.324364 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.324519 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.324672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.324814 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.324966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.325233 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.325393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.325545 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.325702 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.325845 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.325987 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.326129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.326269 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.326411 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.326608 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.326770 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.326914 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.327064 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.327208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.327359 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.327507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.327650 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.327791 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.327939 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.328082 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.328239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.328383 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.328535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.328676 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.328824 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.328967 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.329119 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.329262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.329411 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.329561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.329561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.329847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.329847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.329847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.330268 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.330424 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.330424 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.330750 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.330902 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.331053 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.331210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.331353 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.331494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.331643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.331793 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.331936 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.332300 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.332461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.332739 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.332914 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.333068 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.333212 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.333362 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.333798 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.333952 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.334105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.334266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.334266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.334642 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.334800 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.335037 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.335190 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.335434 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.335584 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.335735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.335877 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.336032 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.336182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.336339 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.336490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.336640 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.336790 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.336943 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.337104 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.337247 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.337397 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.337549 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.337698 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.337850 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.337993 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.338144 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.338287 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.338457 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.338658 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.338809 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.338961 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.339110 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.339260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.339260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.339554 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.339705 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.339855 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.340010 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.340167 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.340324 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.340483 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.340633 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.340782 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.340946 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.341103 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.341258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.341258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.341569 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.341718 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.341875 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.342495 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.342714 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.342876 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.343027 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.343182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.343331 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.343494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.343671 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.344104 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.344255 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.344410 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.344652 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.344810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.344974 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.345123 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.345284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.345590 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.345769 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.345925 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.346100 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.346387 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.346549 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.346733 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.346895 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.347055 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.347205 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.347352 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.347500 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.347648 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.347810 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.347970 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.348137 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.348294 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.348443 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.348591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.348738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.348897 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.349054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.349203 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.349203 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.349507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.349656 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.349813 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.349813 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.350114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.350270 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.350419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.350419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.350735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.350883 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.351032 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.351182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.351343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.351506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.351656 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.351810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.351959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.352117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.352274 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.352639 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.352807 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.352957 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.353119 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.353277 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.353433 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.353594 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.353743 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.354785 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.354946 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.355102 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.355280 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.355435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.355583 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.355832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.355988 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.356136 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.356299 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.356528 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.356691 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.356840 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.356988 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.357393 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.357568 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.357717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.357865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.358013 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.358160 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.358314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.358314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.358649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.358814 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.358971 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.359120 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.359282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.359431 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.359598 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.359747 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.359895 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.360050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.360212 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.360368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.360530 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.360689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.360837 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.360985 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.361143 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.361291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.361446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.361619 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.361777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.361926 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.362084 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.362241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.362391 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.362553 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.362959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.363127 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.363292 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.363442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.363589 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.363744 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.363904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.364147 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.364305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.364452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.364626 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.364993 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.365150 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.365313 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.365465 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.365613 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.365860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.366102 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.366276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.366425 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.366665 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.366824 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.366986 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.367135 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.367135 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.367416 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.367571 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.367720 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.367879 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.368035 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.368191 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.368351 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.368499 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.368655 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.368813 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.368971 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.369128 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.369284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.369432 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.369603 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.370286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.370447 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.370621 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.370804 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.371150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.371150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.371455 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.371613 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.371762 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.371918 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.372075 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.372241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.372391 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.372538 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.372686 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.373138 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.373297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.373473 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.373623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.373771 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.373920 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.374075 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.374307 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.374472 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.374657 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.375658 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.375820 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.375982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.376252 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.376417 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.376886 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.377056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.377208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.377368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.377518 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.377666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.377825 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.377981 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.378131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.378287 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.378440 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.378620 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.378620 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.378938 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.379088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.379236 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.379384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.379661 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.379840 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.379993 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.380141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.380289 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.380445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.380445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.380758 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.380914 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.381072 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.381228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.381376 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.381535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.381692 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.381840 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.381996 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.382151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.382310 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.382467 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.382667 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.382833 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.383212 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.383375 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.383541 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.383701 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.383850 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.383998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.384146 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.384319 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.384543 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.384713 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.384864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.385174 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.385370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.385530 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.385796 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.385960 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.386119 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.386292 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.386541 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.386729 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.386909 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.387135 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.387305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.387469 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.387630 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.387787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.387945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.388102 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.388261 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.388411 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.388559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.388707 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.388865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.389013 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.389587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.389741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.389892 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.390059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.390226 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.390376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.390531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.390713 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.390865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.391024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.391024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.391306 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.391462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.391620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.391769 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.391940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.392097 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.392246 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.392403 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.392559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.392707 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.392865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.393014 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.393404 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.393570 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.393721 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.393869 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.394024 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.394186 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.394342 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.394649 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.394826 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.394976 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.395279 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.395440 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.395597 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.395757 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.396023 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.396175 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.396323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.396471 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.396733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.396902 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.397054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.397282 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.397445 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.397596 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.397831 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.397983 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.398130 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.398279 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.398466 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.398466 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.398811 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.398970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.399127 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.399284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.399440 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.399597 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.399754 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.399903 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.400050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.400050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.400330 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.400486 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.400644 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.400806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.400992 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.401142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.401298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.401298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.401591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.401739 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.401886 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.402033 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.402188 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.402345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.402494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.402681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.402854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.402854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.403155 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.403524 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.403691 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.403841 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.403989 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.404137 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.404285 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.404442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.404600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.404828 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.404991 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.405151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.405469 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.405635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.405785 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.406030 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.406196 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.406196 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.406506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.406683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.406939 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.407100 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.407328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.407499 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.407662 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.407814 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.407970 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.408126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.408275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.408430 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.408593 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.408744 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.408891 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.409046 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.409201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.409366 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.409533 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.409684 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.409833 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.410018 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.410186 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.410350 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.410500 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.410742 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.410906 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.411056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.411204 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.411367 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.411517 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.411683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.411838 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.411988 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.412142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.412301 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.412458 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.412607 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.412755 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.412902 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.413059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.413208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.413557 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.413719 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.413887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.414046 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.414203 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.414361 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.414510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.414692 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.414933 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.415099 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.415273 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.415578 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.415734 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.415883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.416142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.416301 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.417061 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.417229 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.417397 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.417620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.417774 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.417933 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.418082 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.418230 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.418378 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.418534 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.418745 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.418916 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.419065 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.419214 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.419363 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.419363 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.419660 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.419822 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.419979 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.420130 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.420288 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.420436 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.420584 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.420741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.420909 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.421056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.421212 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.421371 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.421535 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.421684 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.421840 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.421988 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.422135 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.422296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.422456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.422650 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.422815 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.422982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.423139 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.423288 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.423447 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.423806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.423962 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.424110 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.424259 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.424414 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.424579 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.424736 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.424885 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.425133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.425302 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.425461 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.425776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.425934 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.426092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.426336 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.426492 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.426734 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.426888 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.427037 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.427299 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.427457 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.427709 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.427878 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.428036 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.428186 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.428341 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.428497 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.428647 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.428810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.428968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.429118 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.429265 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.429421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.429650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.429816 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.429816 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.430109 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.430257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.430412 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.430570 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.430754 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.430913 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.431062 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.431217 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.431374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.431533 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.431690 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.431850 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.432006 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.432208 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.432983 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.433150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.433314 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.433464 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.433614 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.433964 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.434134 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.434292 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.434441 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.434635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.434803 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.434962 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.435208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.435365 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.435529 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.435839 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.436003 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.436164 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.436410 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.436577 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.436577 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.436868 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.437043 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.437290 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.437449 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.437606 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.437833 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.437988 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.438157 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.438157 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.438442 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.438609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.438764 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.438912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.439072 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.439242 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.439391 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.439547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.439695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.439842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.440004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.440004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.440337 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.440493 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.440641 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.440804 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.440967 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.441127 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.441287 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.441435 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.441583 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.441741 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.441896 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.442045 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.442192 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.442341 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.442488 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.442698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.442854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.443014 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.443181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.443332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.443488 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.443488 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.443779 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.444133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.444297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.444297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.444597 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.444747 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.444894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.445043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.445288 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.445454 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.445883 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.446148 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.446313 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.446594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.446755 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.446924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.447081 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.447234 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.447487 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.447653 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.447923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.448092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.448250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.448400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.448555 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.448714 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.448863 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.449022 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.449171 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.449319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.449474 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.449624 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.449787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.449958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.450108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.450257 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.450413 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.450608 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.450779 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.450929 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.451084 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.451240 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.451396 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.451545 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.451710 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.451871 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.452030 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.452030 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.452312 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.452467 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.452626 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.452783 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.452940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.453089 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.453243 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.453243 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.453607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.453755 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.453922 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.454281 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.454446 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.454633 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.454789 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.454947 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.455106 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.455106 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.455493 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.455654 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.455811 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.456094 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.456333 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.456501 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.456761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.456918 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.457068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.457216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.457363 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.457616 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.457787 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.458028 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.458186 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.458343 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.458500 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.458711 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.458886 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.459035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.459191 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.459341 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.459496 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.459653 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.459811 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.459961 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.460109 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.460257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.460412 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.460575 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.460741 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.460890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.461038 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.461195 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.461345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.461506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.461663 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.461811 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.461959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.462112 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.462262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.462420 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.462420 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.462772 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.462922 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.463070 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.463216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.463404 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.463564 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.463721 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.463876 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.464024 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.464398 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.464564 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.464721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.464877 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.465036 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.465200 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.465363 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.465604 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.465753 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.465908 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.466194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.466357 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.466521 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.466698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.466956 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.467114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.467281 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.467281 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.467678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.467841 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.467990 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.468221 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.468379 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.468549 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.468700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.468848 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.469004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.469152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.469300 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.469468 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.469468 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.469760 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.469917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.470066 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.470213 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.470375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.470524 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.470726 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.470887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.471207 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.471366 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.471526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.471687 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.471837 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.471993 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.471993 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.472285 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.472435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.472582 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.472739 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.472901 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.473051 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.473208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.473356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.473520 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.473675 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.473832 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.474085 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.474248 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.474635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.474803 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.474803 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.475103 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.475273 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.475423 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.475652 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.475807 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.475975 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.476258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.476258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.476584 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.476756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.476908 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.477150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.477320 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.477471 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.477620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.477867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.478033 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.478280 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.478446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.478649 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.478817 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.479546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.479739 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.479892 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.480057 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.480207 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.480355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.480355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.480637 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.480796 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.480991 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.481150 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.481299 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.481454 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.481603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.481759 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.481909 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.482064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.482468 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.482642 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.482797 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.482958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.483130 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.483290 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.483439 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.483587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.483741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.483741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.484045 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.484194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.484351 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.484719 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.484887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.485045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.485213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.485367 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.485515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.485681 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.485681 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.486060 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.486210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.486498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.486498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.486826 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.486991 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.487166 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.487401 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.487565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.487714 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.487900 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.488141 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.488319 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.488536 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.488698 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.488848 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.489073 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.489225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.489380 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.489538 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.489706 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.489864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.490027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.490177 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.490325 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.490325 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.490638 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.490805 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.490969 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.491119 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.491275 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.491432 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.491582 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.491749 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.491906 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.492056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.492203 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.492351 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.492498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.492657 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.492806 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.492954 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.493102 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.493250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.493398 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.493555 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.493722 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.493872 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.494027 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.494182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.494339 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.494501 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.495316 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.495474 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.495623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.495782 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.496023 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.496187 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.496486 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.496657 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.496809 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.496959 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.497182 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.497341 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.497591 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.497745 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.497903 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.498101 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.498370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.498617 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.498777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.498940 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.499088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.499247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.499411 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.499561 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.499717 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.499866 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.500015 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.500177 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.500327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.500475 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.500623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.500772 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.500931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.501089 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.501247 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.501397 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.501552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.501701 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.501858 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.502021 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.502172 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.502320 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.502469 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.502651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.502814 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.502982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.503142 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.503293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.503443 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.503591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.503750 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.503900 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.504048 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.504198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.504347 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.504495 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.504658 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.504837 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.504994 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.505143 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.505300 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.505460 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.505621 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.505771 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.505920 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.506161 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.506161 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.506651 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.506834 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.506987 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.507153 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.507311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.507469 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.507646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.507917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.508081 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.508239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.508417 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.508684 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.508849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.509007 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.509158 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.509319 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.509519 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.509682 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.509843 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.510033 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.510192 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.510400 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.510562 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.510806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.510958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.510958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511333 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511333 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511635 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511795 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 05:14:53.511953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.511953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.513088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.513088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.513088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.513088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.513088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.513088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.513088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.513088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.514232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.514232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.514232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.514232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.514232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.514232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.514232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.514232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.515439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.515439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.515439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.515439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.515439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.515439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.515439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.515439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.517043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.517043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.517043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.517043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.517043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.517043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.517043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.517043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.518355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.518355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.518355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.518355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.518355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.518355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.518355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.518355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.519700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.519700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.519700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.519700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.519700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.519700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.519700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.519700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.520849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.520849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.520849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.520849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.520849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.520849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.520849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.520849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.522058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.522058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.522058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.522058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.522058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.522058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.522058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.522058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.523323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.523323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.523323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.523323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.523323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.523323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.523323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.523323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.525054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.525054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.525054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.525054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.525054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.525054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.525054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.525054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.526250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.526250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 05:14:53.526250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 05:14:53.598849 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_db.sqlalchemy.engines [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:14:53.630242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_db.sqlalchemy.engines [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:14:53.678448 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.context [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e(cell1) {{(pid=108137) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 05:14:53.683315 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:14:53.684919 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:14:53.685738 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:14:53.687727 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:14:53.697957 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_db.sqlalchemy.engines [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:14:53.698821 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_db.sqlalchemy.engines [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:14:53.709090 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.context [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e(cell1) {{(pid=108136) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 05:14:53.713931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:14:53.715698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:14:53.716551 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:14:53.718539 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:14:53.729137 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_db.sqlalchemy.engines [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:14:53.730517 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_db.sqlalchemy.engines [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:14:53.957938 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_db.sqlalchemy.engines [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:14:53.996945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_db.sqlalchemy.engines [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 05:14:54.283740 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: WARNING keystonemiddleware.auth_token [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 05:14:54.290251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: WARNING keystonemiddleware.auth_token [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 05:14:54.324491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: WARNING keystonemiddleware.auth_token [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 05:14:54.331096 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: WARNING keystonemiddleware.auth_token [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 05:14:54.636011 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: WARNING keystonemiddleware.auth_token [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 05:14:54.641208 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: WARNING keystonemiddleware.auth_token [None req-47c82a35-d6b6-4fb3-b7b7-a477debe68fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 05:14:54.646355 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d0a1419c0 pid: 108137 (default app) Aug 10 05:14:54.684762 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: WARNING keystonemiddleware.auth_token [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 05:14:54.690032 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: WARNING keystonemiddleware.auth_token [None req-d2233381-f53b-40fd-9b56-a69f34727381 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 05:14:54.695215 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d0a1419c0 pid: 108136 (default app) Aug 10 05:15:28.717428 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d5e7ca9b-52b4-4bd0-8d70-5ede1d9ada70 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Action: 'create', calling method: .version_select at 0x7fb33e3454c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1946819849"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:30.720156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d5e7ca9b-52b4-4bd0-8d70-5ede1d9ada70 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.935443 Aug 10 05:15:30.720780 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Tue Aug 10 05:15:27 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2938 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 05:15:31.221456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1b88aeaa-5c42-45f0-8b65-2296037527cf tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e38f160>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:31.302182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1839252607", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "62cbece0-2795-47f3-940b-91b67c3900d8"}]}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:31.444781 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] validate_networks() for [('62cbece0-2795-47f3-940b-91b67c3900d8', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:15:31.933580 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1b88aeaa-5c42-45f0-8b65-2296037527cf tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2" status: 200 len: 346 microversion: 2.1 time: 1.200848 Aug 10 05:15:31.934679 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:15:30 2021] GET /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2 => generated 346 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:31.947318 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-af87da4d-0931-46bb-8b1f-cddc9a4a1f30 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Action: 'create', calling method: .version_select at 0x7fb33e24df70>, body: {"snapshot": {"volume_id": "3a455fff-ec92-4944-96ae-735784a31ef2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1694733881"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:32.578901 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:15:32.580129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:15:32.580952 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:15:32.581608 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:15:32.582231 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:15:32.597955 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:32.598944 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:32.600317 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:32.601251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:32.664344 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-af87da4d-0931-46bb-8b1f-cddc9a4a1f30 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.721318 Aug 10 05:15:32.664975 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1162 bytes} [Tue Aug 10 05:15:31 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:15:32.671485 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Getting quotas for project 9418eeb2771342b99e046a1b5d9a1ea5. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:32.676860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-edc2e2d2-634b-452f-9a3c-1a00973cc63b tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e20caf0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:32.688672 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Getting quotas for user d54df4b83622480cb64cca23a5b65eda and project 9418eeb2771342b99e046a1b5d9a1ea5. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:32.727963 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:15:32.743935 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:15:32.829605 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-edc2e2d2-634b-452f-9a3c-1a00973cc63b tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 200 len: 287 microversion: 2.1 time: 0.156769 Aug 10 05:15:32.829605 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Aug 10 05:15:32 2021] GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:15:32.840777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5c60f5c8-f832-42a5-8520-933a9bae1b08 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e20ca60>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:32.890967 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5c60f5c8-f832-42a5-8520-933a9bae1b08 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.055869 Aug 10 05:15:32.892186 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 4/5] 10.222.0.16 () {58 vars in 1140 bytes} [Tue Aug 10 05:15:32 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:32.904387 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-fb8052b5-e16d-4957-848f-ee7eadb95a70 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33ebdd670>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:32.963079 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-fb8052b5-e16d-4957-848f-ee7eadb95a70 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 200 len: 287 microversion: 2.1 time: 0.063111 Aug 10 05:15:32.964701 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 5/6] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Aug 10 05:15:32 2021] GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:33.006667 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ea2b2216-96df-4623-8a9d-d7bbf8333bbf tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900324 Aug 10 05:15:33.008038 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 2/7] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:15:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:15:33.017683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7454399e-333a-4afe-aac1-f37507a3c740 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:33.018270 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7454399e-333a-4afe-aac1-f37507a3c740 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:33.293418 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7454399e-333a-4afe-aac1-f37507a3c740 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:33.309994 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7454399e-333a-4afe-aac1-f37507a3c740 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1215 microversion: 2.1 time: 0.296068 Aug 10 05:15:33.310851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 6/8] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:33 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1215 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:33.975838 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-28f5e0c5-cfa1-4cac-a19e-420a7901745a tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e117700>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:34.124862 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-28f5e0c5-cfa1-4cac-a19e-420a7901745a tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 200 len: 287 microversion: 2.1 time: 0.152743 Aug 10 05:15:34.125580 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 3/9] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Aug 10 05:15:33 2021] GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:34.329596 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-58aad4f9-b0cf-4cb5-9ba7-1301c593948e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:34.330838 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-58aad4f9-b0cf-4cb5-9ba7-1301c593948e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:34.886356 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-58aad4f9-b0cf-4cb5-9ba7-1301c593948e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:34.896877 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-58aad4f9-b0cf-4cb5-9ba7-1301c593948e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1215 microversion: 2.1 time: 0.571297 Aug 10 05:15:34.904257 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 7/10] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:34 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1215 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:35.151983 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cd252e52-783a-4cf6-865f-cb0106c5a35b tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e12d310>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:35.189593 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cd252e52-783a-4cf6-865f-cb0106c5a35b tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 200 len: 287 microversion: 2.1 time: 0.051172 Aug 10 05:15:35.189593 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 4/11] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Aug 10 05:15:35 2021] GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:35.914510 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f093f499-311b-4017-b2cf-65cb7c439b13 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:35.915193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f093f499-311b-4017-b2cf-65cb7c439b13 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:35.933496 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f093f499-311b-4017-b2cf-65cb7c439b13 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:35.933954 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f093f499-311b-4017-b2cf-65cb7c439b13 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:35.934773 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f093f499-311b-4017-b2cf-65cb7c439b13 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:35.935209 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f093f499-311b-4017-b2cf-65cb7c439b13 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:36.201280 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b3291816-9e2b-4c08-be05-685560cc0014 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e12dc10>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:36.244006 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f093f499-311b-4017-b2cf-65cb7c439b13 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:36.266541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b3291816-9e2b-4c08-be05-685560cc0014 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 200 len: 287 microversion: 2.1 time: 0.069838 Aug 10 05:15:36.271006 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Aug 10 05:15:36 2021] GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:36.286891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f093f499-311b-4017-b2cf-65cb7c439b13 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1219 microversion: 2.1 time: 0.367613 Aug 10 05:15:36.286891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:35 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1219 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:37.280166 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9cc1417f-b4a2-4247-86e3-427e6b9e66e0 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e12dee0>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:37.306791 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f3ae5f91-7c34-4642-9ac2-a65609fe7983 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:37.307532 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f3ae5f91-7c34-4642-9ac2-a65609fe7983 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:37.328964 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f3ae5f91-7c34-4642-9ac2-a65609fe7983 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:37.329451 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f3ae5f91-7c34-4642-9ac2-a65609fe7983 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:37.330264 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f3ae5f91-7c34-4642-9ac2-a65609fe7983 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:37.330730 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f3ae5f91-7c34-4642-9ac2-a65609fe7983 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:37.353186 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9cc1417f-b4a2-4247-86e3-427e6b9e66e0 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 200 len: 288 microversion: 2.1 time: 0.077564 Aug 10 05:15:37.355292 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 6/14] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Aug 10 05:15:37 2021] GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 288 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:37.366245 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-be9a6464-17ae-484b-86c6-b8ccb7c10ddc tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e12d5e0>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:37.544843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-be9a6464-17ae-484b-86c6-b8ccb7c10ddc tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 202 len: 0 microversion: 2.1 time: 0.183614 Aug 10 05:15:37.545419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1254 bytes} [Tue Aug 10 05:15:37 2021] DELETE /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:15:37.555228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-da3d62e0-3a19-4aa7-8613-0371a7aa8123 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e117f70>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:37.621580 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-da3d62e0-3a19-4aa7-8613-0371a7aa8123 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 200 len: 287 microversion: 2.1 time: 0.070732 Aug 10 05:15:37.625925 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f3ae5f91-7c34-4642-9ac2-a65609fe7983 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:37.628719 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Aug 10 05:15:37 2021] GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:37.639593 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f3ae5f91-7c34-4642-9ac2-a65609fe7983 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1267 microversion: 2.1 time: 0.342933 Aug 10 05:15:37.641393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 9/17] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:37 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:38.613303 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8e1145fe-9cf0-4341-a46a-c688c51f6337 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'create', calling method: .version_select at 0x7fb33e117820>, body: {"keypair": {"name": "tempest-keypair-172929078"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:38.637266 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-61631497-0133-4175-9e28-134fc4b2de48 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e1628b0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:38.671734 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-61631497-0133-4175-9e28-134fc4b2de48 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] HTTP exception thrown: Snapshot cb916094-33ac-4577-92fe-8b20f9368007 could not be found. Aug 10 05:15:38.672522 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-61631497-0133-4175-9e28-134fc4b2de48 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Returning 404 to user: Snapshot cb916094-33ac-4577-92fe-8b20f9368007 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:15:38.673574 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-61631497-0133-4175-9e28-134fc4b2de48 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007" status: 404 len: 111 microversion: 2.1 time: 0.040067 Aug 10 05:15:38.674571 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 10/18] 10.222.0.16 () {58 vars in 1251 bytes} [Tue Aug 10 05:15:38 2021] GET /compute/v2.1/os-snapshots/cb916094-33ac-4577-92fe-8b20f9368007 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:15:38.684568 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b10c65df-7181-4793-a014-86b88fae7e3f tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:38.688992 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b10c65df-7181-4793-a014-86b88fae7e3f tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:38.699477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b10c65df-7181-4793-a014-86b88fae7e3f tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:38.700353 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b10c65df-7181-4793-a014-86b88fae7e3f tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:38.704298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b10c65df-7181-4793-a014-86b88fae7e3f tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:38.705023 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b10c65df-7181-4793-a014-86b88fae7e3f tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:38.737690 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-8e1145fe-9cf0-4341-a46a-c688c51f6337 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:38.737690 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-8e1145fe-9cf0-4341-a46a-c688c51f6337 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for user 490a8522f743475187844c39a4ba6dea and project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:38.991212 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b10c65df-7181-4793-a014-86b88fae7e3f tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:38.999278 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b10c65df-7181-4793-a014-86b88fae7e3f tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1273 microversion: 2.1 time: 0.322062 Aug 10 05:15:39.005076 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 11/19] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:38 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1273 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:39.021110 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-08635e21-f8f4-462a-b17d-649cd818a242 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e162d30>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:39.515438 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-08635e21-f8f4-462a-b17d-649cd818a242 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2" status: 202 len: 0 microversion: 2.1 time: 0.501154 Aug 10 05:15:39.515438 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 12/20] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Aug 10 05:15:39 2021] DELETE /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:15:39.522481 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-06ad7266-db70-4048-8ce8-186789f5016f tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33e0b6280>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:39.650532 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-8e1145fe-9cf0-4341-a46a-c688c51f6337 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:39.669247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-8e1145fe-9cf0-4341-a46a-c688c51f6337 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for user 490a8522f743475187844c39a4ba6dea and project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:39.676931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-06ad7266-db70-4048-8ce8-186789f5016f tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2" status: 200 len: 345 microversion: 2.1 time: 0.162120 Aug 10 05:15:39.678248 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 13/21] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:15:39 2021] GET /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2 => generated 345 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:39.715064 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8e1145fe-9cf0-4341-a46a-c688c51f6337 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.678118 Aug 10 05:15:39.715870 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 9/22] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Aug 10 05:15:38 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:40.023855 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3e9b3d5a-7751-452e-8540-b55c6bcc4966 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:40.025397 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3e9b3d5a-7751-452e-8540-b55c6bcc4966 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:40.047338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3e9b3d5a-7751-452e-8540-b55c6bcc4966 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:40.051150 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3e9b3d5a-7751-452e-8540-b55c6bcc4966 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:40.055596 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3e9b3d5a-7751-452e-8540-b55c6bcc4966 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:40.060323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3e9b3d5a-7751-452e-8540-b55c6bcc4966 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:40.694903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-87dfac05-990d-4498-accb-b337f2d9d551 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33d8d4b80>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:40.894722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-87dfac05-990d-4498-accb-b337f2d9d551 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] HTTP exception thrown: Volume 3a455fff-ec92-4944-96ae-735784a31ef2 could not be found. Aug 10 05:15:40.894722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-87dfac05-990d-4498-accb-b337f2d9d551 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Returning 404 to user: Volume 3a455fff-ec92-4944-96ae-735784a31ef2 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:15:40.894722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-87dfac05-990d-4498-accb-b337f2d9d551 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2" status: 404 len: 109 microversion: 2.1 time: 0.069761 Aug 10 05:15:40.894722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 10/23] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:15:40 2021] GET /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:15:40.894722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-af15ba25-17ba-4b28-bfbc-29b910cd20f5 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33d07c160>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:40.897183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-af15ba25-17ba-4b28-bfbc-29b910cd20f5 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] HTTP exception thrown: Volume 3a455fff-ec92-4944-96ae-735784a31ef2 could not be found. Aug 10 05:15:40.897183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-af15ba25-17ba-4b28-bfbc-29b910cd20f5 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Returning 404 to user: Volume 3a455fff-ec92-4944-96ae-735784a31ef2 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:15:40.897183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-af15ba25-17ba-4b28-bfbc-29b910cd20f5 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2" status: 404 len: 109 microversion: 2.1 time: 0.056008 Aug 10 05:15:40.897183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Aug 10 05:15:40 2021] DELETE /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:15:40.897183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-293c8c93-db4f-4424-bc31-76e0fdb00bd8 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Calling method '.version_select at 0x7fb33d8ed670>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:40.897903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-293c8c93-db4f-4424-bc31-76e0fdb00bd8 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] HTTP exception thrown: Volume 3a455fff-ec92-4944-96ae-735784a31ef2 could not be found. Aug 10 05:15:40.897903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-293c8c93-db4f-4424-bc31-76e0fdb00bd8 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] Returning 404 to user: Volume 3a455fff-ec92-4944-96ae-735784a31ef2 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:15:40.897903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-293c8c93-db4f-4424-bc31-76e0fdb00bd8 tempest-VolumesSnapshotsTestJSON-110277354 tempest-VolumesSnapshotsTestJSON-110277354-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2" status: 404 len: 109 microversion: 2.1 time: 0.061038 Aug 10 05:15:40.901222 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:15:40 2021] GET /compute/v2.1/os-volumes/3a455fff-ec92-4944-96ae-735784a31ef2 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:15:41.120397 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3e9b3d5a-7751-452e-8540-b55c6bcc4966 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:41.133191 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3e9b3d5a-7751-452e-8540-b55c6bcc4966 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 1.119273 Aug 10 05:15:41.134234 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 14/26] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:40 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:42.202196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cdcc1866-f822-411e-986c-e8a398a1651c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:42.202196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cdcc1866-f822-411e-986c-e8a398a1651c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:42.202196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cdcc1866-f822-411e-986c-e8a398a1651c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:42.202196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cdcc1866-f822-411e-986c-e8a398a1651c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:42.210499 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cdcc1866-f822-411e-986c-e8a398a1651c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:42.210499 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cdcc1866-f822-411e-986c-e8a398a1651c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:42.853301 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cdcc1866-f822-411e-986c-e8a398a1651c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:42.880676 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cdcc1866-f822-411e-986c-e8a398a1651c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.730935 Aug 10 05:15:42.889875 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:42 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:43.912341 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6eff6bf7-c0e5-4114-a98d-08c5cae228e1 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:43.913213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6eff6bf7-c0e5-4114-a98d-08c5cae228e1 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:43.926881 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6eff6bf7-c0e5-4114-a98d-08c5cae228e1 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:43.928199 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6eff6bf7-c0e5-4114-a98d-08c5cae228e1 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:43.929793 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6eff6bf7-c0e5-4114-a98d-08c5cae228e1 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:43.931453 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6eff6bf7-c0e5-4114-a98d-08c5cae228e1 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:45.034087 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6eff6bf7-c0e5-4114-a98d-08c5cae228e1 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:45.047585 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6eff6bf7-c0e5-4114-a98d-08c5cae228e1 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 1.143676 Aug 10 05:15:45.051441 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:43 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:46.075205 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-27b16a61-421a-4230-95d4-262f513f6dcb tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:46.076767 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-27b16a61-421a-4230-95d4-262f513f6dcb tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:46.088299 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-27b16a61-421a-4230-95d4-262f513f6dcb tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:46.091556 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-27b16a61-421a-4230-95d4-262f513f6dcb tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:46.092613 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-27b16a61-421a-4230-95d4-262f513f6dcb tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:46.094805 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-27b16a61-421a-4230-95d4-262f513f6dcb tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:46.334884 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-56c029b0-f1b1-4129-9636-6bcab0ac2f23 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'create', calling method: .version_select at 0x7fb33d02f700>, body: {"keypair": {"name": "tempest-keypair-1890370678"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:46.384632 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-56c029b0-f1b1-4129-9636-6bcab0ac2f23 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:46.402734 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-56c029b0-f1b1-4129-9636-6bcab0ac2f23 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for user af5ad45d471648a487e5c95cb63163e8 and project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:46.513104 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-27b16a61-421a-4230-95d4-262f513f6dcb tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:46.527117 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-27b16a61-421a-4230-95d4-262f513f6dcb tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.461319 Aug 10 05:15:46.528987 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:46 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:47.430732 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1747999154", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a86cdb8-2cca-471f-b130-20e1a913f6c2"}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:47.798042 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] validate_networks() for [('0a86cdb8-2cca-471f-b130-20e1a913f6c2', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:15:48.486265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-56c029b0-f1b1-4129-9636-6bcab0ac2f23 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:48.486265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-56c029b0-f1b1-4129-9636-6bcab0ac2f23 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for user af5ad45d471648a487e5c95cb63163e8 and project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:48.486265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-56c029b0-f1b1-4129-9636-6bcab0ac2f23 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.741863 Aug 10 05:15:48.486265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 14/30] 10.222.0.16 () {62 vars in 1199 bytes} [Tue Aug 10 05:15:45 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2743 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 10 05:15:49.454997 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-69e25aea-39fd-4120-93ac-b16648cebc74 req-92ea38b5-9e5a-4a2d-a634-5bb6e4a27acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8698eb3-233c-4555-9695-cef046edd246", "tag": "b1a5739b-5565-4e98-bf9b-b169435bdd11"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:49.456467 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:15:49.456467 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:15:49.472041 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-69e25aea-39fd-4120-93ac-b16648cebc74 req-92ea38b5-9e5a-4a2d-a634-5bb6e4a27acc service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:49.472041 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-69e25aea-39fd-4120-93ac-b16648cebc74 req-92ea38b5-9e5a-4a2d-a634-5bb6e4a27acc service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:49.521312 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-69e25aea-39fd-4120-93ac-b16648cebc74 req-92ea38b5-9e5a-4a2d-a634-5bb6e4a27acc service nova] Creating event network-changed:b1a5739b-5565-4e98-bf9b-b169435bdd11 for instance a8698eb3-233c-4555-9695-cef046edd246 on hv-cinder-80390 Aug 10 05:15:49.521979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-69e25aea-39fd-4120-93ac-b16648cebc74 req-92ea38b5-9e5a-4a2d-a634-5bb6e4a27acc service nova] Acquired lock "compute-rpcapi-router" {{(pid=108137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 10 05:15:49.524235 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2617e054-4897-440c-8763-c1755356e9fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:49.527663 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2617e054-4897-440c-8763-c1755356e9fc None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:49.529631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2617e054-4897-440c-8763-c1755356e9fc None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:49.530882 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2617e054-4897-440c-8763-c1755356e9fc None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:49.551399 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.compute.rpcapi [None req-2617e054-4897-440c-8763-c1755356e9fc None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 10 05:15:49.554165 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2617e054-4897-440c-8763-c1755356e9fc None None] Releasing lock "compute-rpcapi-router" {{(pid=108137) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 10 05:15:49.608825 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2617e054-4897-440c-8763-c1755356e9fc None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.210630 Aug 10 05:15:49.609648 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:15:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:49.616162 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ce5c9d11-3516-4392-978e-4e52b132dc08 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:49.617820 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ce5c9d11-3516-4392-978e-4e52b132dc08 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:49.629713 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d11-3516-4392-978e-4e52b132dc08 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:49.630177 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d11-3516-4392-978e-4e52b132dc08 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:49.630994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d11-3516-4392-978e-4e52b132dc08 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:49.631619 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d11-3516-4392-978e-4e52b132dc08 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:49.896131 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ce5c9d11-3516-4392-978e-4e52b132dc08 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:49.908742 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ce5c9d11-3516-4392-978e-4e52b132dc08 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.297338 Aug 10 05:15:49.909763 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:49 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:49.916026 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-907001927", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5888986-d0a6-413e-a11d-31e19ef566b9"}], "security_groups": [{"name": "tempest-securitygroup--552214377"}], "key_name": "tempest-keypair-172929078", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:50.240051 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] validate_networks() for [('e5888986-d0a6-413e-a11d-31e19ef566b9', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:15:50.989300 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:15:50.991990 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:15:50.992545 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:15:50.992960 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:15:50.993604 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:15:51.045028 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:51.047447 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:51.048488 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:51.052069 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:51.212150 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Getting quotas for project ec44caf79c6e4d48a3d328a58919df19. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:51.234413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Getting quotas for user a561148ea4c14d07a050ca8dc5787085 and project ec44caf79c6e4d48a3d328a58919df19. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:51.287054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:15:51.299567 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:15:51.627314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:15:51.627848 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:15:51.628464 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:15:51.629131 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:15:51.629723 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:15:51.639802 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:51.643668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:51.643668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:51.643668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:51.659839 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:51.669275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for user 490a8522f743475187844c39a4ba6dea and project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:51.688782 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:15:51.691631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:15:51.788298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4c115d78-f836-462a-bb21-6d8082e3c009 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.256587 Aug 10 05:15:51.797913 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 17/33] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:15:46 2021] POST /compute/v2.1/servers => generated 383 bytes in 5267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:15:51.817582 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-71997ad2-7e3d-401a-9af0-b0abb8874e98 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:51.818446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-71997ad2-7e3d-401a-9af0-b0abb8874e98 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:51.845580 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71997ad2-7e3d-401a-9af0-b0abb8874e98 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:51.853877 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71997ad2-7e3d-401a-9af0-b0abb8874e98 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:51.856723 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71997ad2-7e3d-401a-9af0-b0abb8874e98 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:51.857191 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71997ad2-7e3d-401a-9af0-b0abb8874e98 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:51.944471 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0a501552-aee1-401e-8410-852e31b87cc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.033453 Aug 10 05:15:51.945133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:15:49 2021] POST /compute/v2.1/servers => generated 401 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:15:51.966551 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6c7c6765-94a0-4549-806d-b4517f13b77d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:51.966551 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6c7c6765-94a0-4549-806d-b4517f13b77d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:52.216067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-71997ad2-7e3d-401a-9af0-b0abb8874e98 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:52.227246 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-71997ad2-7e3d-401a-9af0-b0abb8874e98 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.427351 Aug 10 05:15:52.237664 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 18/35] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:51 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:52.245744 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-593f20a6-9d07-4bb9-aad1-d59b00d951da tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:52.252352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-593f20a6-9d07-4bb9-aad1-d59b00d951da tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:52.416883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-593f20a6-9d07-4bb9-aad1-d59b00d951da tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:52.426284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-593f20a6-9d07-4bb9-aad1-d59b00d951da tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1236 microversion: 2.1 time: 0.196029 Aug 10 05:15:52.428776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 19/36] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:52 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1236 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:52.595620 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6c7c6765-94a0-4549-806d-b4517f13b77d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:52.629368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6c7c6765-94a0-4549-806d-b4517f13b77d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1222 microversion: 2.1 time: 0.680052 Aug 10 05:15:52.629368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 18/37] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:51 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1222 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:52.953679 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-974815054", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a86cdb8-2cca-471f-b130-20e1a913f6c2"}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:53.108831 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] validate_networks() for [('0a86cdb8-2cca-471f-b130-20e1a913f6c2', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:15:53.245831 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a2d731bb-3ce7-4cf8-951e-9c24637f00e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:53.246636 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a2d731bb-3ce7-4cf8-951e-9c24637f00e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:53.256483 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a2d731bb-3ce7-4cf8-951e-9c24637f00e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:53.257186 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a2d731bb-3ce7-4cf8-951e-9c24637f00e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:53.263008 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a2d731bb-3ce7-4cf8-951e-9c24637f00e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:53.263868 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a2d731bb-3ce7-4cf8-951e-9c24637f00e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:53.643709 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a2d731bb-3ce7-4cf8-951e-9c24637f00e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:53.655520 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a2d731bb-3ce7-4cf8-951e-9c24637f00e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.413896 Aug 10 05:15:53.670542 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 19/38] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:53 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:15:53.686860 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a02d3039-a6e6-4d8c-9303-4d79a1411dfb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:53.686860 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a02d3039-a6e6-4d8c-9303-4d79a1411dfb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:53.856239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a02d3039-a6e6-4d8c-9303-4d79a1411dfb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:53.866339 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a02d3039-a6e6-4d8c-9303-4d79a1411dfb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1236 microversion: 2.1 time: 0.193527 Aug 10 05:15:53.866955 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 20/39] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:53 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1236 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:53.879668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e9917898-8583-40d3-8614-dcb17d53e509 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33cfa8940>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:54.216364 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:15:54.217497 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:15:54.218210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:15:54.218880 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:15:54.219609 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:15:54.232272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:54.233011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:54.236495 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:54.236495 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:54.258183 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Getting quotas for project ec44caf79c6e4d48a3d328a58919df19. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:54.263214 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Getting quotas for user a561148ea4c14d07a050ca8dc5787085 and project ec44caf79c6e4d48a3d328a58919df19. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:54.276662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:15:54.280728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:15:54.498303 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2eda0bc0-8277-4130-841e-052a2aafaa48 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.559888 Aug 10 05:15:54.501208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:15:52 2021] POST /compute/v2.1/servers => generated 383 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:15:54.525127 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-029eb607-b8d7-4ecf-8356-150b0c7ed12b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:54.526514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-029eb607-b8d7-4ecf-8356-150b0c7ed12b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:54.607564 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e9917898-8583-40d3-8614-dcb17d53e509 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ccdcd890-5dd0-41f8-9b72-9873a984a187" status: 200 len: 350 microversion: 2.1 time: 0.730651 Aug 10 05:15:54.608244 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:15:53 2021] GET /compute/v2.1/os-volumes/ccdcd890-5dd0-41f8-9b72-9873a984a187 => generated 350 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:54.637713 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-029eb607-b8d7-4ecf-8356-150b0c7ed12b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:54.645591 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-029eb607-b8d7-4ecf-8356-150b0c7ed12b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1221 microversion: 2.1 time: 0.133053 Aug 10 05:15:54.656015 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:54 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:54.690081 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2d67c887-9491-4bb3-98da-b2f4d914688e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:54.699405 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2d67c887-9491-4bb3-98da-b2f4d914688e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:54.715999 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2d67c887-9491-4bb3-98da-b2f4d914688e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:54.716613 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2d67c887-9491-4bb3-98da-b2f4d914688e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:54.719404 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2d67c887-9491-4bb3-98da-b2f4d914688e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:54.720020 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2d67c887-9491-4bb3-98da-b2f4d914688e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:54.883549 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d16e98ac-0f8d-4d78-b844-d9779ca61e4d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:54.885369 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d16e98ac-0f8d-4d78-b844-d9779ca61e4d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:54.891597 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d16e98ac-0f8d-4d78-b844-d9779ca61e4d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:54.892279 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d16e98ac-0f8d-4d78-b844-d9779ca61e4d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:54.893284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d16e98ac-0f8d-4d78-b844-d9779ca61e4d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:54.893921 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d16e98ac-0f8d-4d78-b844-d9779ca61e4d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:55.029135 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d16e98ac-0f8d-4d78-b844-d9779ca61e4d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:55.037747 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2d67c887-9491-4bb3-98da-b2f4d914688e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:55.040354 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d16e98ac-0f8d-4d78-b844-d9779ca61e4d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1240 microversion: 2.1 time: 0.160364 Aug 10 05:15:55.042711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:54 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1240 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:55.047409 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1986756439", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7136196-3303-4185-b6f3-4307c2ed7cf9"}], "security_groups": [{"name": "tempest-securitygroup--345136370"}], "key_name": "tempest-keypair-1890370678", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:15:55.055855 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2d67c887-9491-4bb3-98da-b2f4d914688e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.383229 Aug 10 05:15:55.065991 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 22/44] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:54 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:55.164290 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] validate_networks() for [('e7136196-3303-4185-b6f3-4307c2ed7cf9', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:15:55.567375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:15:55.567958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:15:55.568286 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:15:55.568695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:15:55.569107 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:15:55.581935 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:55.582404 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:55.583342 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:55.583786 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:55.601042 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:15:55.609319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for user af5ad45d471648a487e5c95cb63163e8 and project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:15:55.621305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:15:55.623601 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:15:55.664720 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fbd47a6c-5606-48d3-9555-c0b0b0bddd13 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:55.665296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fbd47a6c-5606-48d3-9555-c0b0b0bddd13 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:55.732581 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fbd47a6c-5606-48d3-9555-c0b0b0bddd13 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:55.739393 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fbd47a6c-5606-48d3-9555-c0b0b0bddd13 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1221 microversion: 2.1 time: 0.080110 Aug 10 05:15:55.740671 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 23/45] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:55 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:55.815439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1bd34348-b6a6-4a5a-b9b0-bd099fe4b438 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.772546 Aug 10 05:15:55.816116 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 23/46] 10.222.0.16 () {62 vars in 1188 bytes} [Tue Aug 10 05:15:55 2021] POST /compute/v2.1/servers => generated 401 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 05:15:55.826699 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cad4a356-befe-4fff-8c81-35b2606aba3e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:55.827313 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cad4a356-befe-4fff-8c81-35b2606aba3e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:55.877699 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cad4a356-befe-4fff-8c81-35b2606aba3e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:55.885894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cad4a356-befe-4fff-8c81-35b2606aba3e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:55.887694 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cad4a356-befe-4fff-8c81-35b2606aba3e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:55.888778 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cad4a356-befe-4fff-8c81-35b2606aba3e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1282 microversion: 2.20 time: 0.066583 Aug 10 05:15:55.889316 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:15:55 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:15:56.057709 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6f33f573-a405-440d-890f-d41bd81155ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:56.058716 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6f33f573-a405-440d-890f-d41bd81155ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:56.065321 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f33f573-a405-440d-890f-d41bd81155ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:56.068849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f33f573-a405-440d-890f-d41bd81155ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:56.068849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f33f573-a405-440d-890f-d41bd81155ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:56.068849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f33f573-a405-440d-890f-d41bd81155ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:56.073589 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-30515f93-ee28-4850-9f92-a6bec79ea11c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:56.074216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-30515f93-ee28-4850-9f92-a6bec79ea11c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:56.080033 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-30515f93-ee28-4850-9f92-a6bec79ea11c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:56.080491 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-30515f93-ee28-4850-9f92-a6bec79ea11c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:56.081296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-30515f93-ee28-4850-9f92-a6bec79ea11c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:56.081741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-30515f93-ee28-4850-9f92-a6bec79ea11c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:56.129054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6f33f573-a405-440d-890f-d41bd81155ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:56.136808 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6f33f573-a405-440d-890f-d41bd81155ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1240 microversion: 2.1 time: 0.083009 Aug 10 05:15:56.137373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:56 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:56.210565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-30515f93-ee28-4850-9f92-a6bec79ea11c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:56.221490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-30515f93-ee28-4850-9f92-a6bec79ea11c tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.151680 Aug 10 05:15:56.222068 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 25/49] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:56 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:15:56.756802 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-da898106-8167-42be-b7da-470a02404fe1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:56.757441 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-da898106-8167-42be-b7da-470a02404fe1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:56.764146 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-da898106-8167-42be-b7da-470a02404fe1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:56.764589 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-da898106-8167-42be-b7da-470a02404fe1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:56.765416 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-da898106-8167-42be-b7da-470a02404fe1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:56.765804 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-da898106-8167-42be-b7da-470a02404fe1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:56.826604 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-da898106-8167-42be-b7da-470a02404fe1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:56.836066 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-da898106-8167-42be-b7da-470a02404fe1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1225 microversion: 2.1 time: 0.083021 Aug 10 05:15:56.837552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 25/50] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:56 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:56.907907 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-95fcee1f-9797-4db2-902d-8d85943564c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:56.908522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-95fcee1f-9797-4db2-902d-8d85943564c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:56.962297 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-95fcee1f-9797-4db2-902d-8d85943564c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:56.976037 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-95fcee1f-9797-4db2-902d-8d85943564c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:56.977670 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-95fcee1f-9797-4db2-902d-8d85943564c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:56.978759 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-95fcee1f-9797-4db2-902d-8d85943564c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1282 microversion: 2.20 time: 0.074585 Aug 10 05:15:56.990407 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:15:56 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:15:57.152880 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e53dd2e9-9431-403f-be4b-0a3da7492886 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:57.153533 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e53dd2e9-9431-403f-be4b-0a3da7492886 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:57.159400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e53dd2e9-9431-403f-be4b-0a3da7492886 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:57.165723 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e53dd2e9-9431-403f-be4b-0a3da7492886 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:57.165723 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e53dd2e9-9431-403f-be4b-0a3da7492886 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:57.165723 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e53dd2e9-9431-403f-be4b-0a3da7492886 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:57.223802 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-e53dd2e9-9431-403f-be4b-0a3da7492886 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:57.231718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e53dd2e9-9431-403f-be4b-0a3da7492886 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1288 microversion: 2.1 time: 0.082446 Aug 10 05:15:57.232296 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:57 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:57.238477 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5325ea27-ff60-4298-88d1-396bd302c305 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:57.239122 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5325ea27-ff60-4298-88d1-396bd302c305 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:57.250822 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5325ea27-ff60-4298-88d1-396bd302c305 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:57.251281 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5325ea27-ff60-4298-88d1-396bd302c305 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:57.252152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5325ea27-ff60-4298-88d1-396bd302c305 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:57.252537 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5325ea27-ff60-4298-88d1-396bd302c305 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:57.384117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-5325ea27-ff60-4298-88d1-396bd302c305 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:57.392118 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5325ea27-ff60-4298-88d1-396bd302c305 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.157465 Aug 10 05:15:57.392682 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 27/53] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:57 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:57.741602 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-330a788b-3721-4e86-970b-46ce67a26fc6 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33e013dc0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:57.816223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-330a788b-3721-4e86-970b-46ce67a26fc6 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ff40719a-1015-444c-8bac-b2d40145bf40" status: 200 len: 351 microversion: 2.1 time: 0.080399 Aug 10 05:15:57.826407 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:15:57 2021] GET /compute/v2.1/os-volumes/ff40719a-1015-444c-8bac-b2d40145bf40 => generated 351 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:15:57.853436 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-62138268-b430-4fbb-853f-650f6328d1f3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:57.853979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-62138268-b430-4fbb-853f-650f6328d1f3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:57.866309 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-62138268-b430-4fbb-853f-650f6328d1f3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:57.866921 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-62138268-b430-4fbb-853f-650f6328d1f3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:57.867737 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-62138268-b430-4fbb-853f-650f6328d1f3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:57.868187 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-62138268-b430-4fbb-853f-650f6328d1f3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:57.997031 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:57.998081 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:58.004748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:58.005706 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:58.007483 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:58.008130 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:58.122624 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:58.136590 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:58.138712 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:58.141066 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-744b5862-1fa2-47cd-9ef6-a7554738db27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1278 microversion: 2.20 time: 0.146848 Aug 10 05:15:58.142085 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 28/55] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:15:57 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:15:58.159027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-62138268-b430-4fbb-853f-650f6328d1f3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:58.167733 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-62138268-b430-4fbb-853f-650f6328d1f3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1217 microversion: 2.1 time: 0.318043 Aug 10 05:15:58.168381 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 28/56] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:57 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1217 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:58.253538 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-13e8ee4e-cf47-4ac4-ba2d-b043a37c1c73 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:58.253538 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-13e8ee4e-cf47-4ac4-ba2d-b043a37c1c73 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:58.257262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-13e8ee4e-cf47-4ac4-ba2d-b043a37c1c73 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:58.257714 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-13e8ee4e-cf47-4ac4-ba2d-b043a37c1c73 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:58.258688 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-13e8ee4e-cf47-4ac4-ba2d-b043a37c1c73 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:58.259297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-13e8ee4e-cf47-4ac4-ba2d-b043a37c1c73 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:58.320968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-13e8ee4e-cf47-4ac4-ba2d-b043a37c1c73 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:58.328776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-13e8ee4e-cf47-4ac4-ba2d-b043a37c1c73 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1294 microversion: 2.1 time: 0.081728 Aug 10 05:15:58.329599 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 29/57] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:58 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1294 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:58.411461 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ead2ed85-f9c9-429a-9aef-1e22da283c57 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:58.413072 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ead2ed85-f9c9-429a-9aef-1e22da283c57 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:58.422918 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ead2ed85-f9c9-429a-9aef-1e22da283c57 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:58.423667 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ead2ed85-f9c9-429a-9aef-1e22da283c57 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:58.424672 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ead2ed85-f9c9-429a-9aef-1e22da283c57 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:58.425293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ead2ed85-f9c9-429a-9aef-1e22da283c57 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:58.758508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ead2ed85-f9c9-429a-9aef-1e22da283c57 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:58.769235 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ead2ed85-f9c9-429a-9aef-1e22da283c57 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.364260 Aug 10 05:15:58.772281 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 29/58] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:58 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:59.163282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:59.164012 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:59.174954 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:59.177984 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:59.179104 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:59.180728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:59.235612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d472a4be-7741-4e22-8b34-81635301c8fc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:59.235612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d472a4be-7741-4e22-8b34-81635301c8fc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:59.238093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d472a4be-7741-4e22-8b34-81635301c8fc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:59.238551 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d472a4be-7741-4e22-8b34-81635301c8fc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:59.239375 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d472a4be-7741-4e22-8b34-81635301c8fc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:59.242834 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d472a4be-7741-4e22-8b34-81635301c8fc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:59.326551 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:59.349413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:59.350958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:59.352127 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-399aed48-ccad-43a3-bac1-5edd3c1c099a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1334 microversion: 2.20 time: 0.192944 Aug 10 05:15:59.356648 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 30/59] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:15:59 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1334 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:15:59.357467 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b1df2ee3-8247-4439-8a4e-1b7b620d26f4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:59.358079 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b1df2ee3-8247-4439-8a4e-1b7b620d26f4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:59.370660 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1df2ee3-8247-4439-8a4e-1b7b620d26f4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:59.371123 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1df2ee3-8247-4439-8a4e-1b7b620d26f4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:59.371907 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1df2ee3-8247-4439-8a4e-1b7b620d26f4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:59.390735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1df2ee3-8247-4439-8a4e-1b7b620d26f4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:59.460463 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d472a4be-7741-4e22-8b34-81635301c8fc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:59.475219 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d472a4be-7741-4e22-8b34-81635301c8fc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1281 microversion: 2.1 time: 0.278913 Aug 10 05:15:59.490008 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 30/60] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:59 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1281 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:59.669448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b1df2ee3-8247-4439-8a4e-1b7b620d26f4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:15:59.681389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b1df2ee3-8247-4439-8a4e-1b7b620d26f4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.327454 Aug 10 05:15:59.683191 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 31/61] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:59 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:15:59.788587 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9dce86d3-6cd1-42c7-87c6-bc05664c77a3 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:59.790059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9dce86d3-6cd1-42c7-87c6-bc05664c77a3 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:15:59.796851 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9dce86d3-6cd1-42c7-87c6-bc05664c77a3 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:59.797565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9dce86d3-6cd1-42c7-87c6-bc05664c77a3 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:59.798748 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9dce86d3-6cd1-42c7-87c6-bc05664c77a3 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:15:59.799398 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9dce86d3-6cd1-42c7-87c6-bc05664c77a3 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:15:59.884233 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-88675a7b-5188-4d5d-b804-5edc37ac1c6b tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33e0135e0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:15:59.956964 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-88675a7b-5188-4d5d-b804-5edc37ac1c6b tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6a8373f5-d253-4ea5-a152-199099625406" status: 200 len: 350 microversion: 2.1 time: 0.078041 Aug 10 05:15:59.958242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 32/62] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:15:59 2021] GET /compute/v2.1/os-volumes/6a8373f5-d253-4ea5-a152-199099625406 => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:15:59.970645 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-26cc53a9-aa54-4184-bcf3-b93869aca3b2 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33e02a0d0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.088093 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-26cc53a9-aa54-4184-bcf3-b93869aca3b2 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.121236 Aug 10 05:16:00.097403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1134 bytes} [Tue Aug 10 05:15:59 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:00.102517 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-33e90f5a-2fdd-4f38-8e3b-336eef241478 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33e013550>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.211955 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-33e90f5a-2fdd-4f38-8e3b-336eef241478 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.113112 Aug 10 05:16:00.216119 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 34/64] 10.222.0.16 () {58 vars in 1149 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:00.229909 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-079055fe-c321-4f70-8fdb-c9981e557178 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33e0719d0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.328735 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9dce86d3-6cd1-42c7-87c6-bc05664c77a3 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:00.337595 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9dce86d3-6cd1-42c7-87c6-bc05664c77a3 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.552569 Aug 10 05:16:00.342693 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 31/65] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:15:59 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:00.345643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-079055fe-c321-4f70-8fdb-c9981e557178 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.120378 Aug 10 05:16:00.346711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 35/66] 10.222.0.16 () {58 vars in 1134 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:00.358394 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c20bd5ea-ca7a-49c2-9a18-01bf2cf21b13 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33d02f820>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.371148 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.371864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:00.381366 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:00.382205 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:00.383303 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:00.383960 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:00.462678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:00.472217 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:00.473954 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:00.475289 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3188d228-4106-4b0a-99ee-644b0b7064cc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1340 microversion: 2.20 time: 0.108538 Aug 10 05:16:00.476479 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 36/67] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1340 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:16:00.490460 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c20bd5ea-ca7a-49c2-9a18-01bf2cf21b13 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.136414 Aug 10 05:16:00.491060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 32/68] 10.222.0.16 () {58 vars in 1167 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:00.500715 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f4eaf0a2-d757-4573-9fd2-4f0d3ae04959 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.501344 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f4eaf0a2-d757-4573-9fd2-4f0d3ae04959 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:00.502403 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f4b76a3f-b5e9-4aea-95c3-82afe6d8e0aa tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33cfa01f0>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.507341 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4eaf0a2-d757-4573-9fd2-4f0d3ae04959 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:00.507865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4eaf0a2-d757-4573-9fd2-4f0d3ae04959 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:00.509293 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4eaf0a2-d757-4573-9fd2-4f0d3ae04959 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:00.509792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4eaf0a2-d757-4573-9fd2-4f0d3ae04959 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:00.590329 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f4b76a3f-b5e9-4aea-95c3-82afe6d8e0aa tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090436 Aug 10 05:16:00.594931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 33/69] 10.222.0.16 () {58 vars in 1170 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:00.603931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4c8f4552-edc5-47b4-ac02-6f82a6f3f076 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33cfa8430>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.766334 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4c8f4552-edc5-47b4-ac02-6f82a6f3f076 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.166635 Aug 10 05:16:00.766635 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f4eaf0a2-d757-4573-9fd2-4f0d3ae04959 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:00.767672 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 34/70] 10.222.0.16 () {58 vars in 1155 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:00.773414 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b52436b2-36c6-4394-8177-f899f9c4dcda tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.774707 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b52436b2-36c6-4394-8177-f899f9c4dcda tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:00.782533 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b52436b2-36c6-4394-8177-f899f9c4dcda tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:00.783294 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b52436b2-36c6-4394-8177-f899f9c4dcda tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:00.784288 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b52436b2-36c6-4394-8177-f899f9c4dcda tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:00.784978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b52436b2-36c6-4394-8177-f899f9c4dcda tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:00.800331 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f4eaf0a2-d757-4573-9fd2-4f0d3ae04959 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1279 microversion: 2.1 time: 0.302365 Aug 10 05:16:00.802985 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 37/71] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1279 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:00.811468 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-42ae7b63-a52f-4acf-8d3c-939c60c4002b tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33d7e3790>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:00.905425 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-42ae7b63-a52f-4acf-8d3c-939c60c4002b tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098395 Aug 10 05:16:00.906121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 38/72] 10.222.0.16 () {58 vars in 1188 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:00.925153 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9c103a55-1fee-43e2-8509-c6379b5b8210 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] Calling method '.version_select at 0x7fb33e013940>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:01.065877 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9c103a55-1fee-43e2-8509-c6379b5b8210 tempest-VolumesTestJSON-1279522302 tempest-VolumesTestJSON-1279522302-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.150783 Aug 10 05:16:01.066464 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 39/73] 10.222.0.16 () {58 vars in 1155 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:01.354449 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c523b1fe-c0a3-4c20-b8ca-466cf5dd31c6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:01.355449 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c523b1fe-c0a3-4c20-b8ca-466cf5dd31c6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:01.373213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c523b1fe-c0a3-4c20-b8ca-466cf5dd31c6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:01.374157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c523b1fe-c0a3-4c20-b8ca-466cf5dd31c6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:01.376267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c523b1fe-c0a3-4c20-b8ca-466cf5dd31c6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:01.378348 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c523b1fe-c0a3-4c20-b8ca-466cf5dd31c6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:01.430197 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b52436b2-36c6-4394-8177-f899f9c4dcda tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:01.438842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b52436b2-36c6-4394-8177-f899f9c4dcda tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.669123 Aug 10 05:16:01.439425 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 35/74] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:00 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:01.494420 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:01.496648 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:01.509954 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:01.514490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:01.519721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:01.520961 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:01.708465 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:01.717353 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:01.718907 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:01.720544 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6be7b620-c459-414f-8138-490397b848d4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1340 microversion: 2.20 time: 0.229986 Aug 10 05:16:01.721659 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 36/75] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:01 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1340 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:01.790510 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c523b1fe-c0a3-4c20-b8ca-466cf5dd31c6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:01.820106 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6a2793cc-2046-4f33-bd78-61db1fd86ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:01.820957 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6a2793cc-2046-4f33-bd78-61db1fd86ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:01.829944 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6a2793cc-2046-4f33-bd78-61db1fd86ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:01.831412 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6a2793cc-2046-4f33-bd78-61db1fd86ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:01.832761 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6a2793cc-2046-4f33-bd78-61db1fd86ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:01.833337 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6a2793cc-2046-4f33-bd78-61db1fd86ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:01.834609 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c523b1fe-c0a3-4c20-b8ca-466cf5dd31c6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.482962 Aug 10 05:16:01.837539 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 40/76] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:01 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:02.001819 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-386f00a3-df82-451f-9fff-ca462224fa92 req-87337ca3-58b9-4005-9f93-f3a106419b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272edeea-3a02-4556-8e12-3a5de760965d", "tag": "b219101f-21b5-44e7-a715-56a50ee9d61a"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:02.004134 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:02.004134 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:16:02.032087 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-386f00a3-df82-451f-9fff-ca462224fa92 req-87337ca3-58b9-4005-9f93-f3a106419b74 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.032572 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-386f00a3-df82-451f-9fff-ca462224fa92 req-87337ca3-58b9-4005-9f93-f3a106419b74 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:02.084860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-386f00a3-df82-451f-9fff-ca462224fa92 req-87337ca3-58b9-4005-9f93-f3a106419b74 service nova] Creating event network-changed:b219101f-21b5-44e7-a715-56a50ee9d61a for instance 272edeea-3a02-4556-8e12-3a5de760965d on hv-cinder-80390 Aug 10 05:16:02.085401 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-386f00a3-df82-451f-9fff-ca462224fa92 req-87337ca3-58b9-4005-9f93-f3a106419b74 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108136) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 10 05:16:02.086599 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b0ffc41-2fa2-4638-a283-8e57904461f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.087034 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b0ffc41-2fa2-4638-a283-8e57904461f6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:02.087818 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b0ffc41-2fa2-4638-a283-8e57904461f6 None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.088249 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b0ffc41-2fa2-4638-a283-8e57904461f6 None None] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:02.097844 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.compute.rpcapi [None req-0b0ffc41-2fa2-4638-a283-8e57904461f6 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 10 05:16:02.110940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b0ffc41-2fa2-4638-a283-8e57904461f6 None None] Releasing lock "compute-rpcapi-router" {{(pid=108136) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 10 05:16:02.180553 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0b0ffc41-2fa2-4638-a283-8e57904461f6 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182507 Aug 10 05:16:02.181442 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 41/77] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:02.457758 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-829356b0-a239-4ee0-aefd-a2f87a25cade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:02.458473 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-829356b0-a239-4ee0-aefd-a2f87a25cade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:02.468673 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-829356b0-a239-4ee0-aefd-a2f87a25cade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.472433 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-829356b0-a239-4ee0-aefd-a2f87a25cade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:02.472433 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-829356b0-a239-4ee0-aefd-a2f87a25cade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.472433 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-829356b0-a239-4ee0-aefd-a2f87a25cade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:02.574222 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6a2793cc-2046-4f33-bd78-61db1fd86ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:02.583456 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6a2793cc-2046-4f33-bd78-61db1fd86ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.767288 Aug 10 05:16:02.584201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 37/78] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:01 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:02.742806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:02.746185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:02.760414 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.766124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:02.768458 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.768929 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:02.813740 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-829356b0-a239-4ee0-aefd-a2f87a25cade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:02.821126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-829356b0-a239-4ee0-aefd-a2f87a25cade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.368442 Aug 10 05:16:02.832958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 42/79] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:02 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:02.852907 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-01aa2fbc-d697-4188-a5c7-3c61bd1b9bfa tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:02.853618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-01aa2fbc-d697-4188-a5c7-3c61bd1b9bfa tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:02.860983 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-01aa2fbc-d697-4188-a5c7-3c61bd1b9bfa tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.861821 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-01aa2fbc-d697-4188-a5c7-3c61bd1b9bfa tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:02.862892 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-01aa2fbc-d697-4188-a5c7-3c61bd1b9bfa tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:02.863664 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-01aa2fbc-d697-4188-a5c7-3c61bd1b9bfa tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:03.068519 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-01aa2fbc-d697-4188-a5c7-3c61bd1b9bfa tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:03.079783 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-01aa2fbc-d697-4188-a5c7-3c61bd1b9bfa tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.229307 Aug 10 05:16:03.082972 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 43/80] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:02 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:03.446841 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:03.464683 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:03.466437 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:03.470889 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ea4db504-b4d7-4156-a186-0fe54467c875 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.729692 Aug 10 05:16:03.470889 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 38/81] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:02 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:03.485256 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-14eb539b-68eb-45f4-a748-f564bab7cfce req-0923005e-80a3-40a1-811c-22c2f1836920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8698eb3-233c-4555-9695-cef046edd246", "name": "network-vif-plugged", "status": "completed", "tag": "b1a5739b-5565-4e98-bf9b-b169435bdd11"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:03.487098 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:03.487098 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:16:03.493984 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-14eb539b-68eb-45f4-a748-f564bab7cfce req-0923005e-80a3-40a1-811c-22c2f1836920 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:03.494439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-14eb539b-68eb-45f4-a748-f564bab7cfce req-0923005e-80a3-40a1-811c-22c2f1836920 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:03.506531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-14eb539b-68eb-45f4-a748-f564bab7cfce req-0923005e-80a3-40a1-811c-22c2f1836920 service nova] Creating event network-vif-plugged:b1a5739b-5565-4e98-bf9b-b169435bdd11 for instance a8698eb3-233c-4555-9695-cef046edd246 on hv-cinder-80390 Aug 10 05:16:03.512530 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-14eb539b-68eb-45f4-a748-f564bab7cfce req-0923005e-80a3-40a1-811c-22c2f1836920 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118929 Aug 10 05:16:03.513519 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 44/82] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:03.601498 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fdf993a1-e75f-41d7-9e9f-e91401e69692 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:03.602716 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fdf993a1-e75f-41d7-9e9f-e91401e69692 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:03.610815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fdf993a1-e75f-41d7-9e9f-e91401e69692 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:03.612216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fdf993a1-e75f-41d7-9e9f-e91401e69692 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:03.613195 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fdf993a1-e75f-41d7-9e9f-e91401e69692 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:03.613797 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fdf993a1-e75f-41d7-9e9f-e91401e69692 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:03.840979 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-55f63086-1f5a-4c90-a413-00b20d24848a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:03.841677 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-55f63086-1f5a-4c90-a413-00b20d24848a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:03.858732 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-55f63086-1f5a-4c90-a413-00b20d24848a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:03.859381 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-55f63086-1f5a-4c90-a413-00b20d24848a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:03.860394 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-55f63086-1f5a-4c90-a413-00b20d24848a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:03.861906 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-55f63086-1f5a-4c90-a413-00b20d24848a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:04.295579 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-55f63086-1f5a-4c90-a413-00b20d24848a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:04.307244 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-55f63086-1f5a-4c90-a413-00b20d24848a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.470300 Aug 10 05:16:04.307822 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 45/83] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:03 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:04.409295 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fdf993a1-e75f-41d7-9e9f-e91401e69692 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:04.419730 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fdf993a1-e75f-41d7-9e9f-e91401e69692 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.821688 Aug 10 05:16:04.438157 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 39/84] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:03 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:04.448107 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-af19376a-569e-4223-bccd-8ef455b2891b tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:04.450173 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-af19376a-569e-4223-bccd-8ef455b2891b tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:04.466421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af19376a-569e-4223-bccd-8ef455b2891b tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:04.470140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af19376a-569e-4223-bccd-8ef455b2891b tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:04.473264 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af19376a-569e-4223-bccd-8ef455b2891b tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:04.474605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af19376a-569e-4223-bccd-8ef455b2891b tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:04.561632 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-79c4c3bf-9c2d-481b-9cf8-1f26a457c9b9 req-7e4a9350-07f7-4fd2-9b81-2c78328c4f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125a0f58-1cac-47b7-8486-e02530bcfb8f", "tag": "0e39f9de-97c4-4fa4-8a77-9dc21b2123a9"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:04.563203 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:04.563203 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:16:04.575933 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-79c4c3bf-9c2d-481b-9cf8-1f26a457c9b9 req-7e4a9350-07f7-4fd2-9b81-2c78328c4f6b service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:04.576627 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-79c4c3bf-9c2d-481b-9cf8-1f26a457c9b9 req-7e4a9350-07f7-4fd2-9b81-2c78328c4f6b service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:04.590011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-79c4c3bf-9c2d-481b-9cf8-1f26a457c9b9 req-7e4a9350-07f7-4fd2-9b81-2c78328c4f6b service nova] Creating event network-changed:0e39f9de-97c4-4fa4-8a77-9dc21b2123a9 for instance 125a0f58-1cac-47b7-8486-e02530bcfb8f on hv-cinder-80390 Aug 10 05:16:04.595462 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-79c4c3bf-9c2d-481b-9cf8-1f26a457c9b9 req-7e4a9350-07f7-4fd2-9b81-2c78328c4f6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.280823 Aug 10 05:16:04.596592 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 46/85] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:04.602261 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-dd9efc40-9d26-4d67-81b8-8484c15dfd5f req-f381e8b6-0837-4c73-af7a-539eec5319df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "087a4339-30e4-48c7-aae6-024174e2d953", "tag": "547c861b-680d-4e59-b838-09c136bb1bab"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:04.610972 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:04.610972 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:16:04.623695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-dd9efc40-9d26-4d67-81b8-8484c15dfd5f req-f381e8b6-0837-4c73-af7a-539eec5319df service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:04.624457 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-dd9efc40-9d26-4d67-81b8-8484c15dfd5f req-f381e8b6-0837-4c73-af7a-539eec5319df service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:04.639091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-dd9efc40-9d26-4d67-81b8-8484c15dfd5f req-f381e8b6-0837-4c73-af7a-539eec5319df service nova] Creating event network-changed:547c861b-680d-4e59-b838-09c136bb1bab for instance 087a4339-30e4-48c7-aae6-024174e2d953 on hv-cinder-80390 Aug 10 05:16:04.645138 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-dd9efc40-9d26-4d67-81b8-8484c15dfd5f req-f381e8b6-0837-4c73-af7a-539eec5319df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046983 Aug 10 05:16:04.646253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 47/86] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:04.658970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:04.658970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:04.666550 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:04.668249 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:04.669992 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:04.670611 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:04.936614 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:04.948142 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:04.951624 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:04.953286 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-546f4e34-da1e-4699-bd72-9dbd56bdf27f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.304852 Aug 10 05:16:04.954641 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 48/87] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:04 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:05.035887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-af19376a-569e-4223-bccd-8ef455b2891b tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:05.045720 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-af19376a-569e-4223-bccd-8ef455b2891b tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.606175 Aug 10 05:16:05.051620 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 40/88] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:04 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:05.325592 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-244b7d94-9055-4361-a481-e679644e97cc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:05.326714 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-244b7d94-9055-4361-a481-e679644e97cc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:05.335715 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-244b7d94-9055-4361-a481-e679644e97cc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:05.341537 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-244b7d94-9055-4361-a481-e679644e97cc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:05.344814 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-244b7d94-9055-4361-a481-e679644e97cc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:05.345609 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-244b7d94-9055-4361-a481-e679644e97cc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:05.443678 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3abd9a1b-2099-42ab-a9a9-7987d028c6a4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:05.444402 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3abd9a1b-2099-42ab-a9a9-7987d028c6a4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:05.462349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3abd9a1b-2099-42ab-a9a9-7987d028c6a4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:05.463591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3abd9a1b-2099-42ab-a9a9-7987d028c6a4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:05.464649 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3abd9a1b-2099-42ab-a9a9-7987d028c6a4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:05.465311 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3abd9a1b-2099-42ab-a9a9-7987d028c6a4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:05.582431 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-244b7d94-9055-4361-a481-e679644e97cc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:05.592677 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-244b7d94-9055-4361-a481-e679644e97cc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.271392 Aug 10 05:16:05.594141 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 49/89] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:05 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:05.786920 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3abd9a1b-2099-42ab-a9a9-7987d028c6a4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:05.799531 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3abd9a1b-2099-42ab-a9a9-7987d028c6a4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.360005 Aug 10 05:16:05.810920 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 41/90] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:05 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:05.973369 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:05.974013 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:05.981702 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:05.982162 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:05.983756 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:05.984206 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:06.064470 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4de0a2c5-c828-43e8-8fd0-0869a3363436 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:06.065352 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4de0a2c5-c828-43e8-8fd0-0869a3363436 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:06.075044 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4de0a2c5-c828-43e8-8fd0-0869a3363436 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:06.075963 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4de0a2c5-c828-43e8-8fd0-0869a3363436 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:06.077046 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4de0a2c5-c828-43e8-8fd0-0869a3363436 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:06.077647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4de0a2c5-c828-43e8-8fd0-0869a3363436 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:06.275480 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4de0a2c5-c828-43e8-8fd0-0869a3363436 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:06.284224 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4de0a2c5-c828-43e8-8fd0-0869a3363436 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1315 microversion: 2.1 time: 0.224476 Aug 10 05:16:06.285122 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 42/91] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:06 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:06.420808 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:06.434938 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:06.437007 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:06.439039 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9fc29add-17e3-40c0-8100-84dc5c5392be tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.469714 Aug 10 05:16:06.440076 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 50/92] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:05 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:06.609893 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ef06e02e-0274-46d8-a0ec-3fc12d9dbe46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:06.617400 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ef06e02e-0274-46d8-a0ec-3fc12d9dbe46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:06.632622 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ef06e02e-0274-46d8-a0ec-3fc12d9dbe46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:06.633141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ef06e02e-0274-46d8-a0ec-3fc12d9dbe46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:06.633850 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ef06e02e-0274-46d8-a0ec-3fc12d9dbe46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:06.634287 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ef06e02e-0274-46d8-a0ec-3fc12d9dbe46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:06.672057 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-81095ec5-c493-4ef2-8fbe-ae261d36eec5 req-0e305a55-bef9-43d5-820f-3b4afcf45c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39b2d03d-c431-46da-926e-49d6390dcacf", "tag": "8ee89d93-e427-4a75-904d-bbb3508ade44"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:06.674528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:06.674528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:16:06.686457 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-81095ec5-c493-4ef2-8fbe-ae261d36eec5 req-0e305a55-bef9-43d5-820f-3b4afcf45c50 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:06.687186 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-81095ec5-c493-4ef2-8fbe-ae261d36eec5 req-0e305a55-bef9-43d5-820f-3b4afcf45c50 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:06.710374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-81095ec5-c493-4ef2-8fbe-ae261d36eec5 req-0e305a55-bef9-43d5-820f-3b4afcf45c50 service nova] Creating event network-changed:8ee89d93-e427-4a75-904d-bbb3508ade44 for instance 39b2d03d-c431-46da-926e-49d6390dcacf on hv-cinder-80390 Aug 10 05:16:06.722393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-81095ec5-c493-4ef2-8fbe-ae261d36eec5 req-0e305a55-bef9-43d5-820f-3b4afcf45c50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056157 Aug 10 05:16:06.723971 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 51/93] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:06.824825 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-298404f9-9925-41c0-b19e-1faa808e1eb8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:06.826905 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-298404f9-9925-41c0-b19e-1faa808e1eb8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:06.844311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-298404f9-9925-41c0-b19e-1faa808e1eb8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:06.845213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-298404f9-9925-41c0-b19e-1faa808e1eb8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:06.846365 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-298404f9-9925-41c0-b19e-1faa808e1eb8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:06.847274 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-298404f9-9925-41c0-b19e-1faa808e1eb8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:06.908844 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ef06e02e-0274-46d8-a0ec-3fc12d9dbe46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:06.925011 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ef06e02e-0274-46d8-a0ec-3fc12d9dbe46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.318783 Aug 10 05:16:06.931165 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 43/94] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:06 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:07.177240 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-298404f9-9925-41c0-b19e-1faa808e1eb8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:07.185474 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-298404f9-9925-41c0-b19e-1faa808e1eb8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.371480 Aug 10 05:16:07.189094 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 52/95] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:06 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:07.301335 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bd1d7426-d0b3-444f-bccb-7a9f33b75304 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:07.302185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bd1d7426-d0b3-444f-bccb-7a9f33b75304 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:07.309067 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bd1d7426-d0b3-444f-bccb-7a9f33b75304 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:07.309743 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bd1d7426-d0b3-444f-bccb-7a9f33b75304 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:07.310922 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bd1d7426-d0b3-444f-bccb-7a9f33b75304 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:07.311360 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bd1d7426-d0b3-444f-bccb-7a9f33b75304 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:07.458177 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:07.459152 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:07.473297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:07.474175 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:07.475904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:07.476570 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:07.567594 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-bd1d7426-d0b3-444f-bccb-7a9f33b75304 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:07.576994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bd1d7426-d0b3-444f-bccb-7a9f33b75304 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1501 microversion: 2.1 time: 0.279494 Aug 10 05:16:07.586805 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 44/96] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:07 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1501 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:07.649153 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:07.657648 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:07.659385 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:07.660481 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-dad83383-e8f2-4f93-8570-f3e45d9c8b5e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.207045 Aug 10 05:16:07.661036 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 53/97] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:07 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:07.944994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a9975589-9621-41b5-b308-ee15f90dda12 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:07.945866 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a9975589-9621-41b5-b308-ee15f90dda12 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:07.952645 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a9975589-9621-41b5-b308-ee15f90dda12 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:07.953415 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a9975589-9621-41b5-b308-ee15f90dda12 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:07.954418 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a9975589-9621-41b5-b308-ee15f90dda12 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:07.955086 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a9975589-9621-41b5-b308-ee15f90dda12 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:08.127832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a9975589-9621-41b5-b308-ee15f90dda12 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:08.147384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a9975589-9621-41b5-b308-ee15f90dda12 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.204630 Aug 10 05:16:08.147384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 45/98] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:07 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:08.204937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d70e4e34-88d5-44f4-b902-811a065a585d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:08.205477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d70e4e34-88d5-44f4-b902-811a065a585d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:08.211329 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d70e4e34-88d5-44f4-b902-811a065a585d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:08.211772 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d70e4e34-88d5-44f4-b902-811a065a585d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:08.212565 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d70e4e34-88d5-44f4-b902-811a065a585d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:08.213171 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d70e4e34-88d5-44f4-b902-811a065a585d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:08.358937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d70e4e34-88d5-44f4-b902-811a065a585d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:08.369126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d70e4e34-88d5-44f4-b902-811a065a585d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.168094 Aug 10 05:16:08.379109 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 54/99] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:08 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:08.679347 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:08.683205 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:08.690069 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:08.690522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:08.691601 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:08.692191 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:08.864081 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:08.874289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:08.875859 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:08.878183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0cfd9ab8-6d4d-4958-b627-34d4555d59ae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.203009 Aug 10 05:16:08.878796 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 46/100] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:08 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:09.162883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-501255ac-5b34-4254-b4e6-5b463953852e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:09.163580 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-501255ac-5b34-4254-b4e6-5b463953852e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:09.169835 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-501255ac-5b34-4254-b4e6-5b463953852e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.170507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-501255ac-5b34-4254-b4e6-5b463953852e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:09.171302 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-501255ac-5b34-4254-b4e6-5b463953852e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.171731 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-501255ac-5b34-4254-b4e6-5b463953852e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:09.224719 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-8dc4da82-8f9f-48af-bf5f-bf7b306dbfdd req-dd18966e-a820-4ece-b75a-28d6cc3efcee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272edeea-3a02-4556-8e12-3a5de760965d", "name": "network-vif-plugged", "status": "completed", "tag": "b219101f-21b5-44e7-a715-56a50ee9d61a"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:09.227282 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:09.227282 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:16:09.234434 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-8dc4da82-8f9f-48af-bf5f-bf7b306dbfdd req-dd18966e-a820-4ece-b75a-28d6cc3efcee service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.235142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-8dc4da82-8f9f-48af-bf5f-bf7b306dbfdd req-dd18966e-a820-4ece-b75a-28d6cc3efcee service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:09.248945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-8dc4da82-8f9f-48af-bf5f-bf7b306dbfdd req-dd18966e-a820-4ece-b75a-28d6cc3efcee service nova] Creating event network-vif-plugged:b219101f-21b5-44e7-a715-56a50ee9d61a for instance 272edeea-3a02-4556-8e12-3a5de760965d on hv-cinder-80390 Aug 10 05:16:09.264511 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-8dc4da82-8f9f-48af-bf5f-bf7b306dbfdd req-dd18966e-a820-4ece-b75a-28d6cc3efcee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043319 Aug 10 05:16:09.265760 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 47/101] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:09.336253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-501255ac-5b34-4254-b4e6-5b463953852e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:09.344162 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-501255ac-5b34-4254-b4e6-5b463953852e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.184946 Aug 10 05:16:09.344727 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 55/102] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:09 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:09.390221 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1e83b257-4304-4fe1-b75d-01fc697e8c56 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:09.390221 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1e83b257-4304-4fe1-b75d-01fc697e8c56 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:09.397218 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1e83b257-4304-4fe1-b75d-01fc697e8c56 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.397681 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1e83b257-4304-4fe1-b75d-01fc697e8c56 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:09.400244 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1e83b257-4304-4fe1-b75d-01fc697e8c56 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.403439 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1e83b257-4304-4fe1-b75d-01fc697e8c56 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:09.426212 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ddb9bca4-bffd-472f-8ee1-b9b07e33742e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0769f4ac-699c-4e05-a6a5-83d806d7affb"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:09.427389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ddb9bca4-bffd-472f-8ee1-b9b07e33742e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:09.435064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ddb9bca4-bffd-472f-8ee1-b9b07e33742e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.435872 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ddb9bca4-bffd-472f-8ee1-b9b07e33742e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:09.436893 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ddb9bca4-bffd-472f-8ee1-b9b07e33742e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.437478 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ddb9bca4-bffd-472f-8ee1-b9b07e33742e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:09.602947 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1e83b257-4304-4fe1-b75d-01fc697e8c56 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:09.612422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1e83b257-4304-4fe1-b75d-01fc697e8c56 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.229839 Aug 10 05:16:09.613183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 48/103] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:09 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:09.896893 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:09.898156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:09.905565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.906713 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:09.918046 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:09.918046 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:10.082891 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:10.093165 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:10.094905 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:10.096152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-06615098-e4e7-4106-b7bb-6cd62b8b1b36 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.203981 Aug 10 05:16:10.107198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 49/104] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:09 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:16:10.361534 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c073792d-d229-4143-8f65-0c4b51577504 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:10.362545 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c073792d-d229-4143-8f65-0c4b51577504 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:10.369326 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c073792d-d229-4143-8f65-0c4b51577504 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:10.370375 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c073792d-d229-4143-8f65-0c4b51577504 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:10.371380 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c073792d-d229-4143-8f65-0c4b51577504 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:10.371818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c073792d-d229-4143-8f65-0c4b51577504 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:10.544512 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c073792d-d229-4143-8f65-0c4b51577504 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:10.554142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c073792d-d229-4143-8f65-0c4b51577504 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1361 microversion: 2.1 time: 0.196633 Aug 10 05:16:10.556127 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 50/105] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:10 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:10.629859 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-589df424-972f-4c86-b73e-fdb2bd5e61e0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:10.630518 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-589df424-972f-4c86-b73e-fdb2bd5e61e0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:10.631178 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ddb9bca4-bffd-472f-8ee1-b9b07e33742e tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "POST /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.205929 Aug 10 05:16:10.634220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 56/106] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:16:09 2021] POST /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246/os-volume_attachments => generated 194 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:16:10.658155 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-589df424-972f-4c86-b73e-fdb2bd5e61e0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:10.658613 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-589df424-972f-4c86-b73e-fdb2bd5e61e0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:10.659404 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-589df424-972f-4c86-b73e-fdb2bd5e61e0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:10.659842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-589df424-972f-4c86-b73e-fdb2bd5e61e0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:11.025736 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-589df424-972f-4c86-b73e-fdb2bd5e61e0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:11.039902 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-589df424-972f-4c86-b73e-fdb2bd5e61e0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.413586 Aug 10 05:16:11.050008 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 51/107] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:10 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:11.114284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:11.115284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:11.127868 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:11.129942 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:11.131640 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:11.132170 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:11.282237 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:11.289874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:11.291458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:11.293109 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-94276f20-7714-4ac3-bbb2-52d8f3a23c8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.183488 Aug 10 05:16:11.293691 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 57/108] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:11 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:11.571060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e6fd4a37-12b8-4b9d-94af-c1f4e4fc9c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:11.571609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e6fd4a37-12b8-4b9d-94af-c1f4e4fc9c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:11.578235 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e6fd4a37-12b8-4b9d-94af-c1f4e4fc9c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:11.581274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e6fd4a37-12b8-4b9d-94af-c1f4e4fc9c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:11.581274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e6fd4a37-12b8-4b9d-94af-c1f4e4fc9c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:11.581274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e6fd4a37-12b8-4b9d-94af-c1f4e4fc9c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:11.717193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e6fd4a37-12b8-4b9d-94af-c1f4e4fc9c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:11.724571 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e6fd4a37-12b8-4b9d-94af-c1f4e4fc9c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1547 microversion: 2.1 time: 0.157267 Aug 10 05:16:11.725185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 52/109] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:11 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:11.742028 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5c32847b-1349-4d75-8521-028e51bff2ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:11.742624 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5c32847b-1349-4d75-8521-028e51bff2ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:11.749495 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5c32847b-1349-4d75-8521-028e51bff2ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:11.750120 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5c32847b-1349-4d75-8521-028e51bff2ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:11.751114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5c32847b-1349-4d75-8521-028e51bff2ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:11.751981 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5c32847b-1349-4d75-8521-028e51bff2ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:11.832972 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5c32847b-1349-4d75-8521-028e51bff2ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094380 Aug 10 05:16:11.833496 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 58/110] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Aug 10 05:16:11 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:12.057652 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-04e01c62-e8c3-4afa-9371-5a32f3c62870 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:12.058794 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-04e01c62-e8c3-4afa-9371-5a32f3c62870 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:12.064804 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-04e01c62-e8c3-4afa-9371-5a32f3c62870 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:12.065520 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-04e01c62-e8c3-4afa-9371-5a32f3c62870 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:12.066363 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-04e01c62-e8c3-4afa-9371-5a32f3c62870 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:12.066894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-04e01c62-e8c3-4afa-9371-5a32f3c62870 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:12.240673 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-04e01c62-e8c3-4afa-9371-5a32f3c62870 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:12.254766 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-04e01c62-e8c3-4afa-9371-5a32f3c62870 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.201098 Aug 10 05:16:12.257207 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 53/111] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:12 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:12.311482 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:12.312195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:12.318211 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:12.318781 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:12.319733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:12.320168 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:12.831087 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:12.841049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:12.843108 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:12.849325 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1f86997d-7787-442b-8572-ce22c1bb80d3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.542537 Aug 10 05:16:12.850924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 59/112] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:12 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:12.999153 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-c084f5bf-9a41-44b7-9fcf-2b2255e5fc25 req-27b9258d-c92b-4a5f-8ff5-8eb7c86c0722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b2d03d-c431-46da-926e-49d6390dcacf", "name": "network-vif-plugged", "status": "completed", "tag": "8ee89d93-e427-4a75-904d-bbb3508ade44"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:13.000992 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:13.000992 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:16:13.008979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-c084f5bf-9a41-44b7-9fcf-2b2255e5fc25 req-27b9258d-c92b-4a5f-8ff5-8eb7c86c0722 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:13.009425 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-c084f5bf-9a41-44b7-9fcf-2b2255e5fc25 req-27b9258d-c92b-4a5f-8ff5-8eb7c86c0722 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:13.029301 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-c084f5bf-9a41-44b7-9fcf-2b2255e5fc25 req-27b9258d-c92b-4a5f-8ff5-8eb7c86c0722 service nova] Creating event network-vif-plugged:8ee89d93-e427-4a75-904d-bbb3508ade44 for instance 39b2d03d-c431-46da-926e-49d6390dcacf on hv-cinder-80390 Aug 10 05:16:13.037546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-c084f5bf-9a41-44b7-9fcf-2b2255e5fc25 req-27b9258d-c92b-4a5f-8ff5-8eb7c86c0722 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042407 Aug 10 05:16:13.042659 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 54/113] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:13.273281 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9ed59efc-f66e-4a64-9510-b21232b45c9d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:13.273887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9ed59efc-f66e-4a64-9510-b21232b45c9d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:13.281114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9ed59efc-f66e-4a64-9510-b21232b45c9d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:13.281570 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9ed59efc-f66e-4a64-9510-b21232b45c9d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:13.282511 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9ed59efc-f66e-4a64-9510-b21232b45c9d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:13.282994 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9ed59efc-f66e-4a64-9510-b21232b45c9d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:13.516485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9ed59efc-f66e-4a64-9510-b21232b45c9d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:13.529204 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9ed59efc-f66e-4a64-9510-b21232b45c9d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.259511 Aug 10 05:16:13.530267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 60/114] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:13 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:13.693594 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-349e2baf-5cd1-4153-86a4-4753c8eb9ade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:13.695360 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-349e2baf-5cd1-4153-86a4-4753c8eb9ade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:13.695929 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-54fa0469-8468-433c-94c9-bf74cbb6c76b req-17dda2b1-4e0c-4aa3-9223-3086a74ee080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272edeea-3a02-4556-8e12-3a5de760965d", "tag": "b219101f-21b5-44e7-a715-56a50ee9d61a"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:13.697536 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:13.697536 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:16:13.708537 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-349e2baf-5cd1-4153-86a4-4753c8eb9ade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:13.708776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-54fa0469-8468-433c-94c9-bf74cbb6c76b req-17dda2b1-4e0c-4aa3-9223-3086a74ee080 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:13.709235 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-54fa0469-8468-433c-94c9-bf74cbb6c76b req-17dda2b1-4e0c-4aa3-9223-3086a74ee080 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:13.718510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-349e2baf-5cd1-4153-86a4-4753c8eb9ade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:13.718510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-349e2baf-5cd1-4153-86a4-4753c8eb9ade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:13.718510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-349e2baf-5cd1-4153-86a4-4753c8eb9ade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:13.730479 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-54fa0469-8468-433c-94c9-bf74cbb6c76b req-17dda2b1-4e0c-4aa3-9223-3086a74ee080 service nova] Creating event network-changed:b219101f-21b5-44e7-a715-56a50ee9d61a for instance 272edeea-3a02-4556-8e12-3a5de760965d on hv-cinder-80390 Aug 10 05:16:13.743579 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-54fa0469-8468-433c-94c9-bf74cbb6c76b req-17dda2b1-4e0c-4aa3-9223-3086a74ee080 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051002 Aug 10 05:16:13.746051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 61/115] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:13.870417 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:13.872244 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:13.881116 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:13.882081 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:13.882916 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:13.883362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:13.883930 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-349e2baf-5cd1-4153-86a4-4753c8eb9ade tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 14 microversion: 2.1 time: 0.195171 Aug 10 05:16:13.885623 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 55/116] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:13 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:16:14.197131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:14.205285 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:14.222930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:14.222930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4383bd0f-85b4-4b30-9a05-6945f15491d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.345426 Aug 10 05:16:14.222930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 62/117] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:13 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:14.547692 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-50a39188-72dc-4671-878f-204848f68329 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:14.548507 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-50a39188-72dc-4671-878f-204848f68329 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:14.555700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50a39188-72dc-4671-878f-204848f68329 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:14.556149 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50a39188-72dc-4671-878f-204848f68329 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:14.557225 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50a39188-72dc-4671-878f-204848f68329 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:14.558448 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50a39188-72dc-4671-878f-204848f68329 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:14.704243 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-50a39188-72dc-4671-878f-204848f68329 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:14.712013 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-50a39188-72dc-4671-878f-204848f68329 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1321 microversion: 2.1 time: 0.169483 Aug 10 05:16:14.712583 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 56/118] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:14 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:14.897426 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ce1cb9b2-9050-4914-93f0-f37c1b16f4b3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:14.898400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ce1cb9b2-9050-4914-93f0-f37c1b16f4b3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:14.904987 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ce1cb9b2-9050-4914-93f0-f37c1b16f4b3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:14.905430 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ce1cb9b2-9050-4914-93f0-f37c1b16f4b3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:14.906195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ce1cb9b2-9050-4914-93f0-f37c1b16f4b3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:14.906661 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ce1cb9b2-9050-4914-93f0-f37c1b16f4b3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:14.973861 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ce1cb9b2-9050-4914-93f0-f37c1b16f4b3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 14 microversion: 2.1 time: 0.079780 Aug 10 05:16:14.974910 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 63/119] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:14 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:16:15.064646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-0926d610-b1e7-441f-9bda-443144dcca03 req-282c59d9-2c61-4c44-97b4-e1f0c5f3b99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125a0f58-1cac-47b7-8486-e02530bcfb8f", "name": "network-vif-plugged", "status": "completed", "tag": "0e39f9de-97c4-4fa4-8a77-9dc21b2123a9"}, {"server_uuid": "087a4339-30e4-48c7-aae6-024174e2d953", "name": "network-vif-plugged", "status": "completed", "tag": "547c861b-680d-4e59-b838-09c136bb1bab"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:15.066547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:15.066547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:16:15.082307 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-0926d610-b1e7-441f-9bda-443144dcca03 req-282c59d9-2c61-4c44-97b4-e1f0c5f3b99b service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.082804 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-0926d610-b1e7-441f-9bda-443144dcca03 req-282c59d9-2c61-4c44-97b4-e1f0c5f3b99b service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:15.108039 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-0926d610-b1e7-441f-9bda-443144dcca03 req-282c59d9-2c61-4c44-97b4-e1f0c5f3b99b service nova] Creating event network-vif-plugged:0e39f9de-97c4-4fa4-8a77-9dc21b2123a9 for instance 125a0f58-1cac-47b7-8486-e02530bcfb8f on hv-cinder-80390 Aug 10 05:16:15.108559 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-0926d610-b1e7-441f-9bda-443144dcca03 req-282c59d9-2c61-4c44-97b4-e1f0c5f3b99b service nova] Creating event network-vif-plugged:547c861b-680d-4e59-b838-09c136bb1bab for instance 087a4339-30e4-48c7-aae6-024174e2d953 on hv-cinder-80390 Aug 10 05:16:15.126077 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-0926d610-b1e7-441f-9bda-443144dcca03 req-282c59d9-2c61-4c44-97b4-e1f0c5f3b99b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064052 Aug 10 05:16:15.127998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 57/120] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:15 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:15.235646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:15.238179 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:15.245750 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.246211 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:15.247030 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.247533 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:15.394673 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:15.404778 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:15.406664 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:15.408507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-81f75182-9351-404f-9c90-de1b426fa692 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.177328 Aug 10 05:16:15.409185 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 64/121] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:15 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:15.730215 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-909a70ee-8dde-46df-ab36-e5b27c56cf22 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:15.730933 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-909a70ee-8dde-46df-ab36-e5b27c56cf22 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:15.737974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-909a70ee-8dde-46df-ab36-e5b27c56cf22 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.738438 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-909a70ee-8dde-46df-ab36-e5b27c56cf22 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:15.739243 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-909a70ee-8dde-46df-ab36-e5b27c56cf22 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.739684 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-909a70ee-8dde-46df-ab36-e5b27c56cf22 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:15.885030 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-909a70ee-8dde-46df-ab36-e5b27c56cf22 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:15.893140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-909a70ee-8dde-46df-ab36-e5b27c56cf22 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1516 microversion: 2.1 time: 0.167620 Aug 10 05:16:15.893726 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 58/122] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:15 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:15.914915 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-36b0317c-a5ec-4238-97aa-99616a3e38ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:15.915936 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-36b0317c-a5ec-4238-97aa-99616a3e38ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:15.922124 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36b0317c-a5ec-4238-97aa-99616a3e38ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.922598 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36b0317c-a5ec-4238-97aa-99616a3e38ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:15.923560 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36b0317c-a5ec-4238-97aa-99616a3e38ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.924004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36b0317c-a5ec-4238-97aa-99616a3e38ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:15.947476 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-36b0317c-a5ec-4238-97aa-99616a3e38ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lazy-loading 'flavor' on Instance uuid 39b2d03d-c431-46da-926e-49d6390dcacf {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:16:15.989209 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a8347120-d86e-4808-bef2-4bda5b6b342b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:15.990223 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a8347120-d86e-4808-bef2-4bda5b6b342b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:15.996055 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8347120-d86e-4808-bef2-4bda5b6b342b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.996581 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8347120-d86e-4808-bef2-4bda5b6b342b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:15.997409 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8347120-d86e-4808-bef2-4bda5b6b342b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:15.997912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8347120-d86e-4808-bef2-4bda5b6b342b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:16.070826 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a8347120-d86e-4808-bef2-4bda5b6b342b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 14 microversion: 2.1 time: 0.085353 Aug 10 05:16:16.071466 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 59/123] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:15 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 05:16:16.348452 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-36b0317c-a5ec-4238-97aa-99616a3e38ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf/action" status: 200 len: 32 microversion: 2.1 time: 0.437595 Aug 10 05:16:16.349041 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 65/124] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:15 2021] POST /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf/action => generated 32 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:16:16.358340 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6b6a0065-b1a0-4e9c-9e53-2daa01492c78 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:16.359187 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6b6a0065-b1a0-4e9c-9e53-2daa01492c78 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:16.365843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b6a0065-b1a0-4e9c-9e53-2daa01492c78 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:16.366324 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b6a0065-b1a0-4e9c-9e53-2daa01492c78 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:16.367146 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b6a0065-b1a0-4e9c-9e53-2daa01492c78 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:16.367585 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b6a0065-b1a0-4e9c-9e53-2daa01492c78 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:16.431336 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:16.431336 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:16.442198 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:16.442762 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:16.443558 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:16.444002 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:16.543622 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6b6a0065-b1a0-4e9c-9e53-2daa01492c78 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:16.553166 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6b6a0065-b1a0-4e9c-9e53-2daa01492c78 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.198853 Aug 10 05:16:16.554120 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 60/125] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:16 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:16.581398 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:16.589562 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:16.591111 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:16.592193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8e760698-d8d6-4099-82fe-41eaa6e11759 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1407 microversion: 2.20 time: 0.168973 Aug 10 05:16:16.592748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 66/126] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:16 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:16:17.090596 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4006b9c7-e517-4b11-a28f-94239169767e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:17.093334 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4006b9c7-e517-4b11-a28f-94239169767e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:17.097555 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4006b9c7-e517-4b11-a28f-94239169767e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:17.098016 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4006b9c7-e517-4b11-a28f-94239169767e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:17.099021 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4006b9c7-e517-4b11-a28f-94239169767e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:17.099498 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4006b9c7-e517-4b11-a28f-94239169767e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:17.193080 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4006b9c7-e517-4b11-a28f-94239169767e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 14 microversion: 2.1 time: 0.109824 Aug 10 05:16:17.193817 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 61/127] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:17 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:16:17.571047 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-406859ee-2f55-43cd-a6e7-5b501e9d0dac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:17.571844 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-406859ee-2f55-43cd-a6e7-5b501e9d0dac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:17.577755 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-406859ee-2f55-43cd-a6e7-5b501e9d0dac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:17.578456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-406859ee-2f55-43cd-a6e7-5b501e9d0dac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:17.579320 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-406859ee-2f55-43cd-a6e7-5b501e9d0dac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:17.579854 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-406859ee-2f55-43cd-a6e7-5b501e9d0dac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:17.610966 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:17.611924 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:17.618851 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:17.619305 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:17.620614 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:17.621052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:17.705884 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-406859ee-2f55-43cd-a6e7-5b501e9d0dac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:17.713338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-406859ee-2f55-43cd-a6e7-5b501e9d0dac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.146059 Aug 10 05:16:17.714555 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 67/128] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:17 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:17.805848 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:17.818694 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:17.820203 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:17.821348 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-657dfbe6-389a-4b6d-93e4-d544c5c98cb0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1600 microversion: 2.20 time: 0.214642 Aug 10 05:16:17.821946 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 62/129] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:16:17 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:16:17.839743 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a2971777-d156-4ced-b261-1b32733f6e8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:17.840242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a2971777-d156-4ced-b261-1b32733f6e8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:17.846100 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a2971777-d156-4ced-b261-1b32733f6e8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:17.846545 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a2971777-d156-4ced-b261-1b32733f6e8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:17.847544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a2971777-d156-4ced-b261-1b32733f6e8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:17.849702 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a2971777-d156-4ced-b261-1b32733f6e8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:17.928315 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a2971777-d156-4ced-b261-1b32733f6e8c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093004 Aug 10 05:16:17.928910 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 68/130] 10.222.0.16 () {60 vars in 1316 bytes} [Tue Aug 10 05:16:17 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:16:18.204301 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-167033ac-7f25-4e30-97b7-6e7b91e4e380 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:18.205646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-167033ac-7f25-4e30-97b7-6e7b91e4e380 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:18.212369 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-167033ac-7f25-4e30-97b7-6e7b91e4e380 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:18.212832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-167033ac-7f25-4e30-97b7-6e7b91e4e380 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:18.214254 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-167033ac-7f25-4e30-97b7-6e7b91e4e380 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:18.214740 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-167033ac-7f25-4e30-97b7-6e7b91e4e380 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:18.311054 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-167033ac-7f25-4e30-97b7-6e7b91e4e380 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 14 microversion: 2.1 time: 0.109893 Aug 10 05:16:18.312739 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 63/131] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:18 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 05:16:18.739325 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-41389b5a-bb6f-402f-b43c-89055d2285ee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:18.739932 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-41389b5a-bb6f-402f-b43c-89055d2285ee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:18.756095 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-41389b5a-bb6f-402f-b43c-89055d2285ee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:18.756547 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-41389b5a-bb6f-402f-b43c-89055d2285ee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:18.757332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-41389b5a-bb6f-402f-b43c-89055d2285ee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:18.757761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-41389b5a-bb6f-402f-b43c-89055d2285ee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:18.977410 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-41389b5a-bb6f-402f-b43c-89055d2285ee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:18.987046 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-41389b5a-bb6f-402f-b43c-89055d2285ee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.252203 Aug 10 05:16:18.987622 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 69/132] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:18 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:19.341103 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9fbb4c6c-098c-4ff4-a876-330cf410967d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:19.343510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9fbb4c6c-098c-4ff4-a876-330cf410967d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:19.359042 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-87f32907-f12f-424e-8868-63c62467fcba tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:19.359208 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fbb4c6c-098c-4ff4-a876-330cf410967d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:19.359510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fbb4c6c-098c-4ff4-a876-330cf410967d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:19.360295 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fbb4c6c-098c-4ff4-a876-330cf410967d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:19.360616 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-87f32907-f12f-424e-8868-63c62467fcba tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:19.360759 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fbb4c6c-098c-4ff4-a876-330cf410967d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:19.368519 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-87f32907-f12f-424e-8868-63c62467fcba tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:19.369241 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-87f32907-f12f-424e-8868-63c62467fcba tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:19.370039 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-87f32907-f12f-424e-8868-63c62467fcba tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:19.370685 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-87f32907-f12f-424e-8868-63c62467fcba tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:22.651947 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9fbb4c6c-098c-4ff4-a876-330cf410967d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 14 microversion: 2.1 time: 3.331957 Aug 10 05:16:22.653466 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 64/133] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:19 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 14 bytes in 3335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:16:22.659025 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-341532ef-c34d-4ab9-b162-cddec6f9a65c req-f577b881-b7b2-48e3-a3db-a385984c50d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125a0f58-1cac-47b7-8486-e02530bcfb8f", "tag": "0e39f9de-97c4-4fa4-8a77-9dc21b2123a9"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:22.659749 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-87f32907-f12f-424e-8868-63c62467fcba tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 14 microversion: 2.20 time: 3.305720 Aug 10 05:16:22.660445 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 70/134] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:19 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 14 bytes in 3307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:22.660547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:22.660547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:16:22.665666 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c49dde50-e426-45da-b22e-6268668cacb0 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:22.666313 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c49dde50-e426-45da-b22e-6268668cacb0 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:22.668402 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-341532ef-c34d-4ab9-b162-cddec6f9a65c req-f577b881-b7b2-48e3-a3db-a385984c50d0 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:22.668896 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-341532ef-c34d-4ab9-b162-cddec6f9a65c req-f577b881-b7b2-48e3-a3db-a385984c50d0 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:22.673018 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c49dde50-e426-45da-b22e-6268668cacb0 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:22.673544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c49dde50-e426-45da-b22e-6268668cacb0 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:22.674380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c49dde50-e426-45da-b22e-6268668cacb0 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:22.674924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c49dde50-e426-45da-b22e-6268668cacb0 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:22.681600 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-341532ef-c34d-4ab9-b162-cddec6f9a65c req-f577b881-b7b2-48e3-a3db-a385984c50d0 service nova] Creating event network-changed:0e39f9de-97c4-4fa4-8a77-9dc21b2123a9 for instance 125a0f58-1cac-47b7-8486-e02530bcfb8f on hv-cinder-80390 Aug 10 05:16:22.686602 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-341532ef-c34d-4ab9-b162-cddec6f9a65c req-f577b881-b7b2-48e3-a3db-a385984c50d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031898 Aug 10 05:16:22.687258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 65/135] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:22.693652 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-daf970f4-da67-4b17-bd27-d5920ff96843 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:22.694355 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-daf970f4-da67-4b17-bd27-d5920ff96843 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:22.701362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c49dde50-e426-45da-b22e-6268668cacb0 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:16:22.704685 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-daf970f4-da67-4b17-bd27-d5920ff96843 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:22.705310 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-daf970f4-da67-4b17-bd27-d5920ff96843 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:22.706262 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-daf970f4-da67-4b17-bd27-d5920ff96843 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:22.706890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-daf970f4-da67-4b17-bd27-d5920ff96843 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:22.902829 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-daf970f4-da67-4b17-bd27-d5920ff96843 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:22.914566 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-daf970f4-da67-4b17-bd27-d5920ff96843 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.224758 Aug 10 05:16:22.915347 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 66/136] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:22 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:23.210485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c49dde50-e426-45da-b22e-6268668cacb0 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 204 len: 0 microversion: 2.1 time: 0.546342 Aug 10 05:16:23.210485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 71/137] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:16:22 2021] DELETE /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:16:23.216867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-15cb6e09-4362-47e0-b29b-a1be7c6457b6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:23.217472 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-15cb6e09-4362-47e0-b29b-a1be7c6457b6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:23.223374 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-15cb6e09-4362-47e0-b29b-a1be7c6457b6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:23.223822 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-15cb6e09-4362-47e0-b29b-a1be7c6457b6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:23.224607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-15cb6e09-4362-47e0-b29b-a1be7c6457b6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:23.225040 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-15cb6e09-4362-47e0-b29b-a1be7c6457b6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:23.343712 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-15cb6e09-4362-47e0-b29b-a1be7c6457b6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:23.351557 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-15cb6e09-4362-47e0-b29b-a1be7c6457b6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1553 microversion: 2.1 time: 0.138292 Aug 10 05:16:23.352124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 67/138] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:23 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1553 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:23.662556 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e9ff4095-d5b3-484a-8b9c-a10bfc20ebc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:23.663605 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e9ff4095-d5b3-484a-8b9c-a10bfc20ebc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:23.669966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e9ff4095-d5b3-484a-8b9c-a10bfc20ebc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:23.670407 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e9ff4095-d5b3-484a-8b9c-a10bfc20ebc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:23.671194 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e9ff4095-d5b3-484a-8b9c-a10bfc20ebc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:23.671624 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e9ff4095-d5b3-484a-8b9c-a10bfc20ebc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:23.671828 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d9e49997-c552-4bd0-8881-775631266883 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:23.672799 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d9e49997-c552-4bd0-8881-775631266883 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:23.679055 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d9e49997-c552-4bd0-8881-775631266883 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:23.679450 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d9e49997-c552-4bd0-8881-775631266883 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:23.680215 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d9e49997-c552-4bd0-8881-775631266883 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:23.680651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d9e49997-c552-4bd0-8881-775631266883 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:26.390453 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e9ff4095-d5b3-484a-8b9c-a10bfc20ebc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 14 microversion: 2.1 time: 2.731689 Aug 10 05:16:26.391435 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 72/139] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:23 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 14 bytes in 2734 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:16:26.396232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f901d8f7-5bc0-4c40-8a9c-278672a77da7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:26.397072 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f901d8f7-5bc0-4c40-8a9c-278672a77da7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:26.399194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d9e49997-c552-4bd0-8881-775631266883 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 14 microversion: 2.20 time: 2.730788 Aug 10 05:16:26.400332 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 68/140] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:23 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 14 bytes in 2734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:26.405203 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f901d8f7-5bc0-4c40-8a9c-278672a77da7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:26.405657 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f901d8f7-5bc0-4c40-8a9c-278672a77da7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:26.406819 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3fbad4d4-5b23-4df9-a943-28b41c446693 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:26.406944 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f901d8f7-5bc0-4c40-8a9c-278672a77da7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:26.406944 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f901d8f7-5bc0-4c40-8a9c-278672a77da7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:26.407196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3fbad4d4-5b23-4df9-a943-28b41c446693 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:26.414183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3fbad4d4-5b23-4df9-a943-28b41c446693 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:26.414756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3fbad4d4-5b23-4df9-a943-28b41c446693 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:26.415918 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3fbad4d4-5b23-4df9-a943-28b41c446693 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:26.416359 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3fbad4d4-5b23-4df9-a943-28b41c446693 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:26.532271 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f901d8f7-5bc0-4c40-8a9c-278672a77da7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:26.540434 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f901d8f7-5bc0-4c40-8a9c-278672a77da7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.147845 Aug 10 05:16:26.542150 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 73/141] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:26 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:26.611964 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3fbad4d4-5b23-4df9-a943-28b41c446693 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:26.619598 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3fbad4d4-5b23-4df9-a943-28b41c446693 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1553 microversion: 2.1 time: 0.217455 Aug 10 05:16:26.622056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 69/142] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:26 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:27.401465 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-53852ecc-eede-4bd0-ab6c-1625aa5c37ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:27.403428 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-53852ecc-eede-4bd0-ab6c-1625aa5c37ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:27.410847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e4abfac4-12d5-4a7b-9d11-c5993670a87b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:27.411773 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53852ecc-eede-4bd0-ab6c-1625aa5c37ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:27.412223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53852ecc-eede-4bd0-ab6c-1625aa5c37ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:27.412655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e4abfac4-12d5-4a7b-9d11-c5993670a87b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:27.413187 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53852ecc-eede-4bd0-ab6c-1625aa5c37ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:27.413625 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53852ecc-eede-4bd0-ab6c-1625aa5c37ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:27.426247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e4abfac4-12d5-4a7b-9d11-c5993670a87b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:27.426247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e4abfac4-12d5-4a7b-9d11-c5993670a87b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:27.426247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e4abfac4-12d5-4a7b-9d11-c5993670a87b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:27.426247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e4abfac4-12d5-4a7b-9d11-c5993670a87b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:27.509367 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-53852ecc-eede-4bd0-ab6c-1625aa5c37ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 14 microversion: 2.1 time: 0.111457 Aug 10 05:16:27.513069 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 74/143] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:27 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 05:16:27.514173 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e4abfac4-12d5-4a7b-9d11-c5993670a87b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 14 microversion: 2.20 time: 0.107298 Aug 10 05:16:27.517190 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 70/144] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:27 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:27.557886 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8eb46385-ff7e-4592-be4f-395f3c0d6ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:27.558619 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8eb46385-ff7e-4592-be4f-395f3c0d6ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:27.565029 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8eb46385-ff7e-4592-be4f-395f3c0d6ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:27.573513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8eb46385-ff7e-4592-be4f-395f3c0d6ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:27.573513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8eb46385-ff7e-4592-be4f-395f3c0d6ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:27.573513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8eb46385-ff7e-4592-be4f-395f3c0d6ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:27.638491 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1c215280-8eda-47b4-8947-5d6be0190de7 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:27.639356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1c215280-8eda-47b4-8947-5d6be0190de7 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:27.646048 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1c215280-8eda-47b4-8947-5d6be0190de7 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:27.646572 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1c215280-8eda-47b4-8947-5d6be0190de7 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:27.647580 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1c215280-8eda-47b4-8947-5d6be0190de7 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:27.648117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1c215280-8eda-47b4-8947-5d6be0190de7 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:27.702062 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8eb46385-ff7e-4592-be4f-395f3c0d6ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:27.715896 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8eb46385-ff7e-4592-be4f-395f3c0d6ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.162433 Aug 10 05:16:27.716761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 75/145] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:27 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:27.794101 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1c215280-8eda-47b4-8947-5d6be0190de7 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:27.802906 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1c215280-8eda-47b4-8947-5d6be0190de7 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1553 microversion: 2.1 time: 0.169234 Aug 10 05:16:27.803329 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 71/146] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:27 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:28.520700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-56f06110-f428-46fc-a0eb-4ad7e2f815c3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:28.521530 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-56f06110-f428-46fc-a0eb-4ad7e2f815c3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:28.536128 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-dd39659c-f596-456e-aa8a-2b6da349d436 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:28.536128 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-dd39659c-f596-456e-aa8a-2b6da349d436 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:28.536700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-56f06110-f428-46fc-a0eb-4ad7e2f815c3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:28.536700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-56f06110-f428-46fc-a0eb-4ad7e2f815c3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:28.536700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-56f06110-f428-46fc-a0eb-4ad7e2f815c3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:28.536700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-56f06110-f428-46fc-a0eb-4ad7e2f815c3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:28.537017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dd39659c-f596-456e-aa8a-2b6da349d436 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:28.537017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dd39659c-f596-456e-aa8a-2b6da349d436 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:28.537017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dd39659c-f596-456e-aa8a-2b6da349d436 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:28.537017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dd39659c-f596-456e-aa8a-2b6da349d436 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:28.626688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-dd39659c-f596-456e-aa8a-2b6da349d436 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 14 microversion: 2.20 time: 0.105330 Aug 10 05:16:28.627317 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 72/147] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:28 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:28.631056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-56f06110-f428-46fc-a0eb-4ad7e2f815c3 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 487 microversion: 2.1 time: 0.113829 Aug 10 05:16:28.632382 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 76/148] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:28 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 487 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:28.734143 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7249cbab-4f33-48e4-89e5-d948366be267 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:28.734865 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7249cbab-4f33-48e4-89e5-d948366be267 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:28.741498 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7249cbab-4f33-48e4-89e5-d948366be267 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:28.741949 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7249cbab-4f33-48e4-89e5-d948366be267 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:28.742745 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7249cbab-4f33-48e4-89e5-d948366be267 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:28.743185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7249cbab-4f33-48e4-89e5-d948366be267 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:28.820963 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aefbd848-295e-4bc2-8337-1931f4be9364 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:28.821573 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-aefbd848-295e-4bc2-8337-1931f4be9364 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:28.828096 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aefbd848-295e-4bc2-8337-1931f4be9364 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:28.828549 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aefbd848-295e-4bc2-8337-1931f4be9364 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:28.829329 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aefbd848-295e-4bc2-8337-1931f4be9364 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:28.829771 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aefbd848-295e-4bc2-8337-1931f4be9364 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:28.955465 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aefbd848-295e-4bc2-8337-1931f4be9364 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:28.964211 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aefbd848-295e-4bc2-8337-1931f4be9364 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1553 microversion: 2.1 time: 0.147030 Aug 10 05:16:28.964794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 77/149] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:28 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:28.976511 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7249cbab-4f33-48e4-89e5-d948366be267 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:28.983540 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7249cbab-4f33-48e4-89e5-d948366be267 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.253487 Aug 10 05:16:28.984202 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 73/150] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:28 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:29.447352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-dc1980af-f227-4980-8bd0-2b88963f8d8d req-87e32942-3b06-4d74-afe6-3f059d40eee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8698eb3-233c-4555-9695-cef046edd246", "name": "network-vif-deleted", "tag": "b1a5739b-5565-4e98-bf9b-b169435bdd11"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:29.449389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:29.449389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:16:29.459192 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-dc1980af-f227-4980-8bd0-2b88963f8d8d req-87e32942-3b06-4d74-afe6-3f059d40eee1 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:29.459639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-dc1980af-f227-4980-8bd0-2b88963f8d8d req-87e32942-3b06-4d74-afe6-3f059d40eee1 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:29.471572 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-dc1980af-f227-4980-8bd0-2b88963f8d8d req-87e32942-3b06-4d74-afe6-3f059d40eee1 service nova] Creating event network-vif-deleted:b1a5739b-5565-4e98-bf9b-b169435bdd11 for instance a8698eb3-233c-4555-9695-cef046edd246 on hv-cinder-80390 Aug 10 05:16:29.476786 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-dc1980af-f227-4980-8bd0-2b88963f8d8d req-87e32942-3b06-4d74-afe6-3f059d40eee1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 Aug 10 05:16:29.477546 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 78/151] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:29.638088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ce1f8b92-a979-4105-a3a5-cf350c8edbc1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:29.641160 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ce1f8b92-a979-4105-a3a5-cf350c8edbc1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:29.644713 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ba9d8f4e-8a69-46de-b31c-dfda8fdafdc5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:29.645150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce1f8b92-a979-4105-a3a5-cf350c8edbc1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:29.645556 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce1f8b92-a979-4105-a3a5-cf350c8edbc1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:29.645746 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ba9d8f4e-8a69-46de-b31c-dfda8fdafdc5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:29.646255 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce1f8b92-a979-4105-a3a5-cf350c8edbc1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:29.646712 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce1f8b92-a979-4105-a3a5-cf350c8edbc1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:29.654370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ba9d8f4e-8a69-46de-b31c-dfda8fdafdc5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:29.655466 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ba9d8f4e-8a69-46de-b31c-dfda8fdafdc5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:29.658484 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ba9d8f4e-8a69-46de-b31c-dfda8fdafdc5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:29.660487 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ba9d8f4e-8a69-46de-b31c-dfda8fdafdc5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:29.726227 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ce1f8b92-a979-4105-a3a5-cf350c8edbc1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 14 microversion: 2.20 time: 0.092659 Aug 10 05:16:29.727046 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 74/152] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:29 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:29.743786 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ba9d8f4e-8a69-46de-b31c-dfda8fdafdc5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 9302 microversion: 2.1 time: 0.099999 Aug 10 05:16:29.743786 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 79/153] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:29 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 9302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:29.982319 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6b3892e8-c548-4dd5-a9f6-68f65b919113 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:29.983033 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6b3892e8-c548-4dd5-a9f6-68f65b919113 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:29.989572 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b3892e8-c548-4dd5-a9f6-68f65b919113 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:29.990031 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b3892e8-c548-4dd5-a9f6-68f65b919113 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:29.990812 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b3892e8-c548-4dd5-a9f6-68f65b919113 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:29.991253 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b3892e8-c548-4dd5-a9f6-68f65b919113 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:30.001312 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aff99f5a-56fc-4d33-a957-a61e84373f58 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:30.002129 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-aff99f5a-56fc-4d33-a957-a61e84373f58 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:30.008695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aff99f5a-56fc-4d33-a957-a61e84373f58 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:30.009220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aff99f5a-56fc-4d33-a957-a61e84373f58 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:30.010105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aff99f5a-56fc-4d33-a957-a61e84373f58 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:30.010675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aff99f5a-56fc-4d33-a957-a61e84373f58 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:30.054530 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6b3892e8-c548-4dd5-a9f6-68f65b919113 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:30.063732 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6b3892e8-c548-4dd5-a9f6-68f65b919113 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1346 microversion: 2.1 time: 0.086066 Aug 10 05:16:30.064655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 75/154] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:29 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:30.140329 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aff99f5a-56fc-4d33-a957-a61e84373f58 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:30.148225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aff99f5a-56fc-4d33-a957-a61e84373f58 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.150906 Aug 10 05:16:30.149170 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 80/155] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:29 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:30.741932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-433f7e96-34d2-4bbe-9401-f164139a7800 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:30.741932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-433f7e96-34d2-4bbe-9401-f164139a7800 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:30.749425 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-433f7e96-34d2-4bbe-9401-f164139a7800 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:30.750064 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-433f7e96-34d2-4bbe-9401-f164139a7800 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:30.751217 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-054a9ad1-ae78-4408-8880-d81e5c5f3316 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:30.751894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-433f7e96-34d2-4bbe-9401-f164139a7800 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:30.752129 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-054a9ad1-ae78-4408-8880-d81e5c5f3316 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:30.752771 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-433f7e96-34d2-4bbe-9401-f164139a7800 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:30.758374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-054a9ad1-ae78-4408-8880-d81e5c5f3316 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:30.758854 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-054a9ad1-ae78-4408-8880-d81e5c5f3316 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:30.761892 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-054a9ad1-ae78-4408-8880-d81e5c5f3316 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:30.762357 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-054a9ad1-ae78-4408-8880-d81e5c5f3316 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:30.840389 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-433f7e96-34d2-4bbe-9401-f164139a7800 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 14 microversion: 2.20 time: 0.106541 Aug 10 05:16:30.841159 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 76/156] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:30 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:30.861041 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-054a9ad1-ae78-4408-8880-d81e5c5f3316 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 13447 microversion: 2.1 time: 0.113372 Aug 10 05:16:30.866118 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 81/157] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:30 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 13447 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:16:31.081867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:31.083323 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:31.089697 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.090147 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.090931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.091365 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.124748 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.125205 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.125676 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lazy-loading 'fault' on Instance uuid a8698eb3-233c-4555-9695-cef046edd246 {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:16:31.166374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-722e0724-80bb-4abc-9df3-308124b67937 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:31.169598 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-722e0724-80bb-4abc-9df3-308124b67937 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:31.174500 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-722e0724-80bb-4abc-9df3-308124b67937 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.175051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-722e0724-80bb-4abc-9df3-308124b67937 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.176043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-722e0724-80bb-4abc-9df3-308124b67937 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.176043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-722e0724-80bb-4abc-9df3-308124b67937 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.178410 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54df4b83622480cb64cca23a5b65eda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9418eeb2771342b99e046a1b5d9a1ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:31.185817 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-33325cc7-001a-4d7d-b3bd-c088a6bb6267 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 200 len: 1305 microversion: 2.1 time: 0.108190 Aug 10 05:16:31.186382 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 77/158] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:31 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:31.311039 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-722e0724-80bb-4abc-9df3-308124b67937 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:31.318311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-722e0724-80bb-4abc-9df3-308124b67937 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.156492 Aug 10 05:16:31.321605 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 82/159] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:31 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:31.851308 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cf7decfd-c329-4b98-b5c0-1c18701117f1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:31.852223 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cf7decfd-c329-4b98-b5c0-1c18701117f1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:31.858853 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cf7decfd-c329-4b98-b5c0-1c18701117f1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.859306 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cf7decfd-c329-4b98-b5c0-1c18701117f1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.860077 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cf7decfd-c329-4b98-b5c0-1c18701117f1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.860514 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cf7decfd-c329-4b98-b5c0-1c18701117f1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.876667 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9e620652-82e6-41a5-8276-c1ff7f2d799b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:31.877614 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9e620652-82e6-41a5-8276-c1ff7f2d799b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:31.883636 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9e620652-82e6-41a5-8276-c1ff7f2d799b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.884082 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9e620652-82e6-41a5-8276-c1ff7f2d799b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.884919 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9e620652-82e6-41a5-8276-c1ff7f2d799b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:31.885354 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9e620652-82e6-41a5-8276-c1ff7f2d799b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:31.938369 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cf7decfd-c329-4b98-b5c0-1c18701117f1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 14 microversion: 2.20 time: 0.090675 Aug 10 05:16:31.939067 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 78/160] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:31 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:31.967215 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9e620652-82e6-41a5-8276-c1ff7f2d799b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 16515 microversion: 2.1 time: 0.094582 Aug 10 05:16:31.967830 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 83/161] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:31 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 16515 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:32.209286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:32.209940 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:32.216945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.217459 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.218222 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.218688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.231943 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] HTTP exception thrown: Instance a8698eb3-233c-4555-9695-cef046edd246 could not be found. Aug 10 05:16:32.232516 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Returning 404 to user: Instance a8698eb3-233c-4555-9695-cef046edd246 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:32.234291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-98c8d9c3-e36d-4a61-b5d8-0608e2a538e8 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 404 len: 111 microversion: 2.1 time: 0.028316 Aug 10 05:16:32.234291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 79/162] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:32 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:16:32.336513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4c680b67-4d7e-46f6-b882-e8cf6154077b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:32.337791 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4c680b67-4d7e-46f6-b882-e8cf6154077b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:32.343210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:32.344112 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:32.344482 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c680b67-4d7e-46f6-b882-e8cf6154077b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.344940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c680b67-4d7e-46f6-b882-e8cf6154077b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.345883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c680b67-4d7e-46f6-b882-e8cf6154077b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.346318 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c680b67-4d7e-46f6-b882-e8cf6154077b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.349822 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.350334 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.351119 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.351551 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.364449 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] HTTP exception thrown: Instance a8698eb3-233c-4555-9695-cef046edd246 could not be found. Aug 10 05:16:32.365035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Returning 404 to user: Instance a8698eb3-233c-4555-9695-cef046edd246 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:32.365852 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cd89d0df-22a5-4bf9-9105-d37a66954cd6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027073 Aug 10 05:16:32.366533 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 80/163] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:16:32 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:16:32.486448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4c680b67-4d7e-46f6-b882-e8cf6154077b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:32.494515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4c680b67-4d7e-46f6-b882-e8cf6154077b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.161829 Aug 10 05:16:32.495221 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 84/164] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:32 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:32.949891 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bbb557ce-b3b3-4d3f-9148-d5dcbbe3b884 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:32.950977 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bbb557ce-b3b3-4d3f-9148-d5dcbbe3b884 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:32.958883 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bbb557ce-b3b3-4d3f-9148-d5dcbbe3b884 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.959367 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bbb557ce-b3b3-4d3f-9148-d5dcbbe3b884 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.960151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bbb557ce-b3b3-4d3f-9148-d5dcbbe3b884 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.960590 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bbb557ce-b3b3-4d3f-9148-d5dcbbe3b884 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.980610 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1379cee4-2821-4144-8606-396c2221572f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:32.980610 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1379cee4-2821-4144-8606-396c2221572f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:32.985880 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1379cee4-2821-4144-8606-396c2221572f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.986728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1379cee4-2821-4144-8606-396c2221572f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:32.987765 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1379cee4-2821-4144-8606-396c2221572f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:32.988197 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1379cee4-2821-4144-8606-396c2221572f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:33.039326 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bbb557ce-b3b3-4d3f-9148-d5dcbbe3b884 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 14 microversion: 2.20 time: 0.093647 Aug 10 05:16:33.039953 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 81/165] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:32 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:33.062499 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1379cee4-2821-4144-8606-396c2221572f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 17686 microversion: 2.1 time: 0.087461 Aug 10 05:16:33.065285 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 85/166] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:32 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 17686 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:33.511841 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5b00173b-8a1c-430d-ac82-9e5ad78ee508 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:33.512562 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5b00173b-8a1c-430d-ac82-9e5ad78ee508 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:33.537396 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5b00173b-8a1c-430d-ac82-9e5ad78ee508 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:33.538052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5b00173b-8a1c-430d-ac82-9e5ad78ee508 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:33.539437 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5b00173b-8a1c-430d-ac82-9e5ad78ee508 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:33.540017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5b00173b-8a1c-430d-ac82-9e5ad78ee508 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:33.718261 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-5b00173b-8a1c-430d-ac82-9e5ad78ee508 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:33.725598 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5b00173b-8a1c-430d-ac82-9e5ad78ee508 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.217683 Aug 10 05:16:33.728817 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 82/167] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:33 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:33.884672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:33.885466 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:33.897101 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:33.897614 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:33.898436 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:33.898901 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:33.920412 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] HTTP exception thrown: Instance a8698eb3-233c-4555-9695-cef046edd246 could not be found. Aug 10 05:16:33.921240 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Returning 404 to user: Instance a8698eb3-233c-4555-9695-cef046edd246 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:33.922751 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c91a1395-7f09-48ca-8424-d53e7074a900 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 404 len: 111 microversion: 2.1 time: 0.044246 Aug 10 05:16:33.923821 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 86/168] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:16:33 2021] DELETE /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:16:33.931234 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:33.931840 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] [instance: a8698eb3-233c-4555-9695-cef046edd246] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:33.938351 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:33.938847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:33.939635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:33.940074 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:33.956068 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] HTTP exception thrown: Instance a8698eb3-233c-4555-9695-cef046edd246 could not be found. Aug 10 05:16:33.956605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] Returning 404 to user: Instance a8698eb3-233c-4555-9695-cef046edd246 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:33.957453 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8b8a133d-1fbc-4fa6-a6dc-2819fe0674a6 tempest-DeleteServersTestJSON-772874386 tempest-DeleteServersTestJSON-772874386-project] 10.222.0.16 "GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246" status: 404 len: 111 microversion: 2.1 time: 0.029843 Aug 10 05:16:33.958002 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 83/169] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:33 2021] GET /compute/v2.1/servers/a8698eb3-233c-4555-9695-cef046edd246 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:16:34.050036 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-69c8255b-a06a-4ce6-9c15-22af39f76393 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:34.051288 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-69c8255b-a06a-4ce6-9c15-22af39f76393 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:34.057782 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-69c8255b-a06a-4ce6-9c15-22af39f76393 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:34.058834 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-69c8255b-a06a-4ce6-9c15-22af39f76393 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:34.059915 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-69c8255b-a06a-4ce6-9c15-22af39f76393 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:34.060507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-69c8255b-a06a-4ce6-9c15-22af39f76393 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:34.076385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ee566a91-7aeb-4658-a1bf-c40560bc13a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:34.079372 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ee566a91-7aeb-4658-a1bf-c40560bc13a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:34.088651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ee566a91-7aeb-4658-a1bf-c40560bc13a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:34.089474 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ee566a91-7aeb-4658-a1bf-c40560bc13a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:34.091797 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ee566a91-7aeb-4658-a1bf-c40560bc13a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:34.092310 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ee566a91-7aeb-4658-a1bf-c40560bc13a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:34.156183 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-69c8255b-a06a-4ce6-9c15-22af39f76393 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 2086 microversion: 2.20 time: 0.107043 Aug 10 05:16:34.157473 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 87/170] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:34 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 2086 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:34.172621 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ee566a91-7aeb-4658-a1bf-c40560bc13a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 18056 microversion: 2.1 time: 0.101382 Aug 10 05:16:34.173199 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 84/171] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:34 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 18056 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:34.743522 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-36a6f32e-f65b-4154-a2a1-1a70b68de9bc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:34.744241 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-36a6f32e-f65b-4154-a2a1-1a70b68de9bc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:34.751597 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36a6f32e-f65b-4154-a2a1-1a70b68de9bc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:34.752055 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36a6f32e-f65b-4154-a2a1-1a70b68de9bc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:34.752856 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36a6f32e-f65b-4154-a2a1-1a70b68de9bc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:34.753319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36a6f32e-f65b-4154-a2a1-1a70b68de9bc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:34.879170 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-36a6f32e-f65b-4154-a2a1-1a70b68de9bc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:34.886461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-36a6f32e-f65b-4154-a2a1-1a70b68de9bc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.146950 Aug 10 05:16:34.887554 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 88/172] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:34 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:35.167980 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-92dd0588-6aa1-42b7-8083-18ed73e99e4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:35.169087 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-92dd0588-6aa1-42b7-8083-18ed73e99e4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:35.175340 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-92dd0588-6aa1-42b7-8083-18ed73e99e4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:35.175786 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-92dd0588-6aa1-42b7-8083-18ed73e99e4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:35.176556 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-92dd0588-6aa1-42b7-8083-18ed73e99e4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:35.176984 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-92dd0588-6aa1-42b7-8083-18ed73e99e4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:35.189201 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a2db27af-cc15-42ad-ac37-2403dbda5ca6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:35.191067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a2db27af-cc15-42ad-ac37-2403dbda5ca6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:35.200173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a2db27af-cc15-42ad-ac37-2403dbda5ca6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:35.200945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a2db27af-cc15-42ad-ac37-2403dbda5ca6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:35.202559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a2db27af-cc15-42ad-ac37-2403dbda5ca6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:35.203260 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a2db27af-cc15-42ad-ac37-2403dbda5ca6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:35.251216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-92dd0588-6aa1-42b7-8083-18ed73e99e4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 9709 microversion: 2.20 time: 0.087121 Aug 10 05:16:35.251852 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 85/173] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:35 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 9709 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:16:35.271916 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a2db27af-cc15-42ad-ac37-2403dbda5ca6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 20173 microversion: 2.1 time: 0.090132 Aug 10 05:16:35.272655 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 89/174] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:35 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 20173 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:35.906151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-09886915-aa6b-40d8-8f8a-f2fe4a4128e8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:35.907755 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-09886915-aa6b-40d8-8f8a-f2fe4a4128e8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:35.914673 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-09886915-aa6b-40d8-8f8a-f2fe4a4128e8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:35.915126 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-09886915-aa6b-40d8-8f8a-f2fe4a4128e8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:35.915900 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-09886915-aa6b-40d8-8f8a-f2fe4a4128e8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:35.916328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-09886915-aa6b-40d8-8f8a-f2fe4a4128e8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:36.069822 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-09886915-aa6b-40d8-8f8a-f2fe4a4128e8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:36.077542 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-09886915-aa6b-40d8-8f8a-f2fe4a4128e8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.177981 Aug 10 05:16:36.078107 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 86/175] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:35 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:36.263913 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-eb096546-ea32-46ef-8bfb-9fab8eab2a0f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:36.264927 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-eb096546-ea32-46ef-8bfb-9fab8eab2a0f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:36.271623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eb096546-ea32-46ef-8bfb-9fab8eab2a0f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:36.272064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eb096546-ea32-46ef-8bfb-9fab8eab2a0f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:36.272819 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eb096546-ea32-46ef-8bfb-9fab8eab2a0f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:36.273250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eb096546-ea32-46ef-8bfb-9fab8eab2a0f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:36.283641 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-907e2d8f-b309-4dcc-9ebd-62c1ec3937df tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:36.284553 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-907e2d8f-b309-4dcc-9ebd-62c1ec3937df tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:36.290388 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-907e2d8f-b309-4dcc-9ebd-62c1ec3937df tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:36.290878 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-907e2d8f-b309-4dcc-9ebd-62c1ec3937df tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:36.291645 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-907e2d8f-b309-4dcc-9ebd-62c1ec3937df tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:36.292082 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-907e2d8f-b309-4dcc-9ebd-62c1ec3937df tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:36.351904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-eb096546-ea32-46ef-8bfb-9fab8eab2a0f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 15025 microversion: 2.20 time: 0.092885 Aug 10 05:16:36.353190 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 90/176] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:36 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 15025 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:36.362952 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-907e2d8f-b309-4dcc-9ebd-62c1ec3937df tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 22121 microversion: 2.1 time: 0.082467 Aug 10 05:16:36.363583 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 87/177] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:36 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 22121 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:37.094704 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b2f0cfb0-b18d-4cc9-b1a9-0f69d16df70c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:37.095543 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b2f0cfb0-b18d-4cc9-b1a9-0f69d16df70c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:37.103130 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b2f0cfb0-b18d-4cc9-b1a9-0f69d16df70c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:37.103585 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b2f0cfb0-b18d-4cc9-b1a9-0f69d16df70c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:37.104423 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b2f0cfb0-b18d-4cc9-b1a9-0f69d16df70c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:37.104862 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b2f0cfb0-b18d-4cc9-b1a9-0f69d16df70c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:37.126503 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e1e863ec-0d77-474c-bcde-f9ebaacd5bb9 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Action: 'create', calling method: .version_select at 0x7fb33cecdf70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1206842473", "metadata": {"Type": "work"}}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:37.128130 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e1e863ec-0d77-474c-bcde-f9ebaacd5bb9 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:37.128930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e1e863ec-0d77-474c-bcde-f9ebaacd5bb9 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.252622 Aug 10 05:16:37.129575 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 91/178] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Aug 10 05:16:36 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 05:16:37.141976 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c53f87e7-b0db-4d50-ad97-eeee0d163720 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Action: 'create', calling method: .version_select at 0x7fb33cdfcc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2130014131", "metadata": {"Type": "work"}}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:37.150860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c53f87e7-b0db-4d50-ad97-eeee0d163720 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:37.150860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c53f87e7-b0db-4d50-ad97-eeee0d163720 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008710 Aug 10 05:16:37.150860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 92/179] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Aug 10 05:16:37 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 05:16:37.158260 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c667e5ca-0da0-4cfd-8225-e4fafee64c14 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Action: 'create', calling method: .version_select at 0x7fb33e38fb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1259179796", "metadata": {"Type": "work"}}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:37.160125 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c667e5ca-0da0-4cfd-8225-e4fafee64c14 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:37.160787 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c667e5ca-0da0-4cfd-8225-e4fafee64c14 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006578 Aug 10 05:16:37.161578 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 93/180] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Aug 10 05:16:37 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 05:16:37.172853 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aa616661-2f44-439e-9fc5-142f8a825f3c tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Calling method '.version_select at 0x7fb33d7c5a60>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:37.208678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-aa616661-2f44-439e-9fc5-142f8a825f3c tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] HTTP exception thrown: Volume tempest-invalid-2087436780 could not be found. Aug 10 05:16:37.209278 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aa616661-2f44-439e-9fc5-142f8a825f3c tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Returning 404 to user: Volume tempest-invalid-2087436780 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:37.210133 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aa616661-2f44-439e-9fc5-142f8a825f3c tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2087436780" status: 404 len: 99 microversion: 2.1 time: 0.042289 Aug 10 05:16:37.215586 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 94/181] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Aug 10 05:16:37 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-2087436780 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 05:16:37.222397 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-cd77d1cb-0735-40e6-b0a7-99177cea20f9 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005327 Aug 10 05:16:37.223315 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 95/182] 10.222.0.16 () {58 vars in 1140 bytes} [Tue Aug 10 05:16:37 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 05:16:37.232545 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-21e240c3-07c8-4526-984a-743a322a5ec5 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003589 Aug 10 05:16:37.234235 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 96/183] 10.222.0.16 () {58 vars in 1137 bytes} [Tue Aug 10 05:16:37 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 05:16:37.248521 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b2f0cfb0-b18d-4cc9-b1a9-0f69d16df70c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:37.250701 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4a86d725-b446-4843-a93d-c068f7098f15 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Calling method '.version_select at 0x7fb33e16d0d0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:37.256023 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b2f0cfb0-b18d-4cc9-b1a9-0f69d16df70c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.165345 Aug 10 05:16:37.258976 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 88/184] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:37 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:37.292450 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-4a86d725-b446-4843-a93d-c068f7098f15 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] HTTP exception thrown: Volume b7208533-7866-43c0-b49d-bd3e2bfcad35 could not be found. Aug 10 05:16:37.293202 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4a86d725-b446-4843-a93d-c068f7098f15 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Returning 404 to user: Volume b7208533-7866-43c0-b49d-bd3e2bfcad35 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:37.294856 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4a86d725-b446-4843-a93d-c068f7098f15 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/b7208533-7866-43c0-b49d-bd3e2bfcad35" status: 404 len: 109 microversion: 2.1 time: 0.049870 Aug 10 05:16:37.295924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 97/185] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Aug 10 05:16:37 2021] DELETE /compute/v2.1/os-volumes/b7208533-7866-43c0-b49d-bd3e2bfcad35 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:16:37.304863 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-36a2e48f-b0f6-40b1-95d9-f52ba466a576 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Calling method '.version_select at 0x7fb33d07c670>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:37.339851 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-36a2e48f-b0f6-40b1-95d9-f52ba466a576 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] HTTP exception thrown: Volume 4812e515-8446-47b9-8741-34f02cb1c79d could not be found. Aug 10 05:16:37.340838 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-36a2e48f-b0f6-40b1-95d9-f52ba466a576 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] Returning 404 to user: Volume 4812e515-8446-47b9-8741-34f02cb1c79d could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:16:37.341680 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-36a2e48f-b0f6-40b1-95d9-f52ba466a576 tempest-VolumesNegativeTest-1131513773 tempest-VolumesNegativeTest-1131513773-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4812e515-8446-47b9-8741-34f02cb1c79d" status: 404 len: 109 microversion: 2.1 time: 0.040733 Aug 10 05:16:37.342209 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 89/186] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:16:37 2021] GET /compute/v2.1/os-volumes/4812e515-8446-47b9-8741-34f02cb1c79d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:16:37.365568 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1875d2ab-b44d-424b-a3c7-0e51c9c86c00 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:37.367270 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1875d2ab-b44d-424b-a3c7-0e51c9c86c00 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:37.376295 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1875d2ab-b44d-424b-a3c7-0e51c9c86c00 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:37.376469 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3e763fe5-d381-46b0-9579-26f41b680de6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:37.376623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1875d2ab-b44d-424b-a3c7-0e51c9c86c00 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:37.376727 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3e763fe5-d381-46b0-9579-26f41b680de6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:37.376817 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1875d2ab-b44d-424b-a3c7-0e51c9c86c00 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:37.376817 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1875d2ab-b44d-424b-a3c7-0e51c9c86c00 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:37.382320 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3e763fe5-d381-46b0-9579-26f41b680de6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:37.382803 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3e763fe5-d381-46b0-9579-26f41b680de6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:37.383568 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3e763fe5-d381-46b0-9579-26f41b680de6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:37.383998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3e763fe5-d381-46b0-9579-26f41b680de6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:37.441785 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1875d2ab-b44d-424b-a3c7-0e51c9c86c00 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 18155 microversion: 2.20 time: 0.080074 Aug 10 05:16:37.442419 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 98/187] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:37 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 18155 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:16:37.466815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3e763fe5-d381-46b0-9579-26f41b680de6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 23603 microversion: 2.1 time: 0.095798 Aug 10 05:16:37.467652 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 90/188] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:37 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 23603 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:38.277105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4fff5d31-86a7-46e2-bb45-d099be3ca0a2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:38.278302 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4fff5d31-86a7-46e2-bb45-d099be3ca0a2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:38.285471 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4fff5d31-86a7-46e2-bb45-d099be3ca0a2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:38.285924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4fff5d31-86a7-46e2-bb45-d099be3ca0a2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:38.286807 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4fff5d31-86a7-46e2-bb45-d099be3ca0a2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:38.287504 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4fff5d31-86a7-46e2-bb45-d099be3ca0a2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:38.418988 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4fff5d31-86a7-46e2-bb45-d099be3ca0a2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:38.426298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4fff5d31-86a7-46e2-bb45-d099be3ca0a2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.153822 Aug 10 05:16:38.426959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 99/189] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:38 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:38.453740 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-431c4999-3c41-4475-b3d7-f90bad7f0c26 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:38.454774 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-431c4999-3c41-4475-b3d7-f90bad7f0c26 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:38.461206 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-431c4999-3c41-4475-b3d7-f90bad7f0c26 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:38.461697 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-431c4999-3c41-4475-b3d7-f90bad7f0c26 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:38.462452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-431c4999-3c41-4475-b3d7-f90bad7f0c26 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:38.462910 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-431c4999-3c41-4475-b3d7-f90bad7f0c26 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:38.483393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b6e7ee90-5425-42d1-82d5-e7a9a022a226 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:38.484480 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b6e7ee90-5425-42d1-82d5-e7a9a022a226 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:38.490930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b6e7ee90-5425-42d1-82d5-e7a9a022a226 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:38.491430 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b6e7ee90-5425-42d1-82d5-e7a9a022a226 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:38.492207 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b6e7ee90-5425-42d1-82d5-e7a9a022a226 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:38.492680 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b6e7ee90-5425-42d1-82d5-e7a9a022a226 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:40.939417 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-431c4999-3c41-4475-b3d7-f90bad7f0c26 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 22156 microversion: 2.20 time: 2.483658 Aug 10 05:16:40.940665 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 91/190] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:38 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 22156 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:40.943432 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b6e7ee90-5425-42d1-82d5-e7a9a022a226 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 26015 microversion: 2.1 time: 2.463527 Aug 10 05:16:40.944944 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 100/191] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:38 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 26015 bytes in 2466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:40.946916 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4a96835f-cb90-4cba-a342-bff21c9914f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:40.955134 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4a96835f-cb90-4cba-a342-bff21c9914f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:40.968253 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a96835f-cb90-4cba-a342-bff21c9914f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:40.968706 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a96835f-cb90-4cba-a342-bff21c9914f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:40.969500 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a96835f-cb90-4cba-a342-bff21c9914f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:40.969937 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a96835f-cb90-4cba-a342-bff21c9914f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:41.104104 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4a96835f-cb90-4cba-a342-bff21c9914f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:41.113272 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4a96835f-cb90-4cba-a342-bff21c9914f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.171111 Aug 10 05:16:41.113852 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 92/192] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:40 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:41.952604 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-37791276-a623-4bec-863f-f8960a3846f0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:41.953596 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-37791276-a623-4bec-863f-f8960a3846f0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:41.956371 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-55a09d4c-4c83-4319-af77-c116eaf03ff0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:41.957374 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-55a09d4c-4c83-4319-af77-c116eaf03ff0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:41.960859 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-37791276-a623-4bec-863f-f8960a3846f0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:41.961310 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-37791276-a623-4bec-863f-f8960a3846f0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:41.962078 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-37791276-a623-4bec-863f-f8960a3846f0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:41.962523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-37791276-a623-4bec-863f-f8960a3846f0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:41.964304 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-55a09d4c-4c83-4319-af77-c116eaf03ff0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:41.964885 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-55a09d4c-4c83-4319-af77-c116eaf03ff0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:41.965858 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-55a09d4c-4c83-4319-af77-c116eaf03ff0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:41.966289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-55a09d4c-4c83-4319-af77-c116eaf03ff0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:42.038777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-37791276-a623-4bec-863f-f8960a3846f0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 23221 microversion: 2.20 time: 0.090770 Aug 10 05:16:42.039795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 101/193] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:41 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 23221 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:42.066381 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-55a09d4c-4c83-4319-af77-c116eaf03ff0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 26749 microversion: 2.1 time: 0.114176 Aug 10 05:16:42.070626 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 93/194] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:41 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 26749 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:42.130710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-fcc83b35-f7f7-4965-b8bd-1365cec4e3d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:42.131419 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-fcc83b35-f7f7-4965-b8bd-1365cec4e3d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:42.142252 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fcc83b35-f7f7-4965-b8bd-1365cec4e3d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:42.143776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fcc83b35-f7f7-4965-b8bd-1365cec4e3d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:42.144026 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fcc83b35-f7f7-4965-b8bd-1365cec4e3d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:42.144680 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fcc83b35-f7f7-4965-b8bd-1365cec4e3d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:42.295253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-fcc83b35-f7f7-4965-b8bd-1365cec4e3d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:42.302749 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-fcc83b35-f7f7-4965-b8bd-1365cec4e3d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.176060 Aug 10 05:16:42.303380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 102/195] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:42 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:43.050445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c43876dc-69e9-4bd8-942d-a757ee3f765b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:43.051571 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c43876dc-69e9-4bd8-942d-a757ee3f765b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:43.059613 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c43876dc-69e9-4bd8-942d-a757ee3f765b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:43.060326 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c43876dc-69e9-4bd8-942d-a757ee3f765b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:43.061241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c43876dc-69e9-4bd8-942d-a757ee3f765b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:43.061745 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c43876dc-69e9-4bd8-942d-a757ee3f765b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:43.077976 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d6ebc0ea-29d6-4abc-8eff-6462e629fcad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:43.078990 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d6ebc0ea-29d6-4abc-8eff-6462e629fcad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:43.100162 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d6ebc0ea-29d6-4abc-8eff-6462e629fcad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:43.100622 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d6ebc0ea-29d6-4abc-8eff-6462e629fcad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:43.101414 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d6ebc0ea-29d6-4abc-8eff-6462e629fcad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:43.101861 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d6ebc0ea-29d6-4abc-8eff-6462e629fcad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:43.173092 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c43876dc-69e9-4bd8-942d-a757ee3f765b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 24497 microversion: 2.20 time: 0.126451 Aug 10 05:16:43.177228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 94/196] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:43 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 24497 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:43.197937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d6ebc0ea-29d6-4abc-8eff-6462e629fcad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 27323 microversion: 2.1 time: 0.123877 Aug 10 05:16:43.199956 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 103/197] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:43 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 27323 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:43.320413 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8db80311-69df-4ec3-b2a9-73459531de25 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:43.321114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8db80311-69df-4ec3-b2a9-73459531de25 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:43.328419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8db80311-69df-4ec3-b2a9-73459531de25 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:43.328872 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8db80311-69df-4ec3-b2a9-73459531de25 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:43.329653 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8db80311-69df-4ec3-b2a9-73459531de25 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:43.330265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8db80311-69df-4ec3-b2a9-73459531de25 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:43.463909 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8db80311-69df-4ec3-b2a9-73459531de25 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:43.471617 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8db80311-69df-4ec3-b2a9-73459531de25 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.155290 Aug 10 05:16:43.472176 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 95/198] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:43 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:44.185400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b1ae1904-04d4-45a1-983c-19b184e83d3d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:44.186515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b1ae1904-04d4-45a1-983c-19b184e83d3d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:44.193503 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1ae1904-04d4-45a1-983c-19b184e83d3d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:44.194134 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1ae1904-04d4-45a1-983c-19b184e83d3d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:44.200820 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1ae1904-04d4-45a1-983c-19b184e83d3d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:44.200820 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1ae1904-04d4-45a1-983c-19b184e83d3d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:44.217339 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-df877378-c422-46e1-8f57-c1eaf3510364 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:44.217339 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-df877378-c422-46e1-8f57-c1eaf3510364 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:44.224912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df877378-c422-46e1-8f57-c1eaf3510364 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:44.228077 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df877378-c422-46e1-8f57-c1eaf3510364 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:44.228077 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df877378-c422-46e1-8f57-c1eaf3510364 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:44.228077 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df877378-c422-46e1-8f57-c1eaf3510364 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:44.291373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b1ae1904-04d4-45a1-983c-19b184e83d3d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 25406 microversion: 2.20 time: 0.109810 Aug 10 05:16:44.295129 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 104/199] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:44 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 25406 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:44.323450 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-df877378-c422-46e1-8f57-c1eaf3510364 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 27628 microversion: 2.1 time: 0.113716 Aug 10 05:16:44.324494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 96/200] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:44 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 27628 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:16:44.489890 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a45b10c5-b6e5-4c81-ab84-6b0de00f88ba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:44.490755 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a45b10c5-b6e5-4c81-ab84-6b0de00f88ba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:44.497231 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a45b10c5-b6e5-4c81-ab84-6b0de00f88ba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:44.498272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a45b10c5-b6e5-4c81-ab84-6b0de00f88ba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:44.499092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a45b10c5-b6e5-4c81-ab84-6b0de00f88ba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:44.499534 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a45b10c5-b6e5-4c81-ab84-6b0de00f88ba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:44.619795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a45b10c5-b6e5-4c81-ab84-6b0de00f88ba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:44.628026 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a45b10c5-b6e5-4c81-ab84-6b0de00f88ba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.142443 Aug 10 05:16:44.628467 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 105/201] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:44 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:45.306093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-46ca55eb-d404-4491-9f28-37462326e6da tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:45.307196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-46ca55eb-d404-4491-9f28-37462326e6da tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:45.315603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-46ca55eb-d404-4491-9f28-37462326e6da tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:45.316052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-46ca55eb-d404-4491-9f28-37462326e6da tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:45.316881 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-46ca55eb-d404-4491-9f28-37462326e6da tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:45.317309 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-46ca55eb-d404-4491-9f28-37462326e6da tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:45.337043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-007a9d58-3a50-456e-8d78-ac585e115401 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:45.337949 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-007a9d58-3a50-456e-8d78-ac585e115401 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:45.344157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-007a9d58-3a50-456e-8d78-ac585e115401 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:45.345389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-007a9d58-3a50-456e-8d78-ac585e115401 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:45.346269 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-007a9d58-3a50-456e-8d78-ac585e115401 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:45.346747 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-007a9d58-3a50-456e-8d78-ac585e115401 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:47.465171 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-46ca55eb-d404-4491-9f28-37462326e6da tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 27542 microversion: 2.20 time: 2.164572 Aug 10 05:16:47.469876 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 97/202] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:45 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 27542 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:47.471518 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-32ecb652-7f9d-42d9-9cfa-dc8592824855 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:47.472283 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-32ecb652-7f9d-42d9-9cfa-dc8592824855 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:47.478685 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-32ecb652-7f9d-42d9-9cfa-dc8592824855 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:47.479152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-32ecb652-7f9d-42d9-9cfa-dc8592824855 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:47.479994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-32ecb652-7f9d-42d9-9cfa-dc8592824855 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:47.480593 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-32ecb652-7f9d-42d9-9cfa-dc8592824855 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:47.489917 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-007a9d58-3a50-456e-8d78-ac585e115401 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 27862 microversion: 2.1 time: 2.156453 Aug 10 05:16:47.491056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 106/203] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:45 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 27862 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:47.645803 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-32ecb652-7f9d-42d9-9cfa-dc8592824855 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:47.654054 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-32ecb652-7f9d-42d9-9cfa-dc8592824855 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.186211 Aug 10 05:16:47.654714 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 98/204] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:47 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:48.477439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-cd11da50-5972-4558-82a5-20f2a53ad226 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:48.478540 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-cd11da50-5972-4558-82a5-20f2a53ad226 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:48.485866 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd11da50-5972-4558-82a5-20f2a53ad226 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:48.486320 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd11da50-5972-4558-82a5-20f2a53ad226 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:48.487130 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd11da50-5972-4558-82a5-20f2a53ad226 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:48.487835 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd11da50-5972-4558-82a5-20f2a53ad226 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:48.501170 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4af1c1fc-55db-4efd-9832-8b6f0a7dc45a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:48.509112 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4af1c1fc-55db-4efd-9832-8b6f0a7dc45a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:48.509112 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4af1c1fc-55db-4efd-9832-8b6f0a7dc45a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:48.509112 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4af1c1fc-55db-4efd-9832-8b6f0a7dc45a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:48.509653 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4af1c1fc-55db-4efd-9832-8b6f0a7dc45a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:48.510091 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4af1c1fc-55db-4efd-9832-8b6f0a7dc45a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:48.555826 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-cd11da50-5972-4558-82a5-20f2a53ad226 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 27778 microversion: 2.20 time: 0.082230 Aug 10 05:16:48.556724 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 107/205] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:48 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 27778 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:48.583406 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4af1c1fc-55db-4efd-9832-8b6f0a7dc45a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 28223 microversion: 2.1 time: 0.085676 Aug 10 05:16:48.584045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 99/206] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:48 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 28223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:48.672046 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ee7992ae-67a7-4382-9023-3a0414214627 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:48.672670 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ee7992ae-67a7-4382-9023-3a0414214627 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:48.679155 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ee7992ae-67a7-4382-9023-3a0414214627 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:48.679802 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ee7992ae-67a7-4382-9023-3a0414214627 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:48.680780 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ee7992ae-67a7-4382-9023-3a0414214627 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:48.681220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ee7992ae-67a7-4382-9023-3a0414214627 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:48.695657 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-146593934", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "71726d26-d4cb-4b88-b610-ac7c500ea4d2"}]}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:48.764014 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] validate_networks() for [('71726d26-d4cb-4b88-b610-ac7c500ea4d2', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:16:48.821076 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ee7992ae-67a7-4382-9023-3a0414214627 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:48.829848 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ee7992ae-67a7-4382-9023-3a0414214627 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.162415 Aug 10 05:16:48.830722 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 108/207] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:48 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:49.136034 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:16:49.139885 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:16:49.139885 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:16:49.139885 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:16:49.139885 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:16:49.147734 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:49.148184 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:49.148985 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:49.149422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:49.165260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Getting quotas for project 2d4061dd7eb245a69b1eff088985076c. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:16:49.169282 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Getting quotas for user 4c80843a900943ecb7d312088d9bf04b and project 2d4061dd7eb245a69b1eff088985076c. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:16:49.180640 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:16:49.183095 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:16:49.385269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-282a49e6-fb8b-4d2e-be2c-6b014bc53380 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693627 Aug 10 05:16:49.386045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 100/208] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:16:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 05:16:49.396017 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-01628055-8eaa-4fef-b75e-c59a490ab5fa tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:49.397928 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-01628055-8eaa-4fef-b75e-c59a490ab5fa tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:49.453975 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-01628055-8eaa-4fef-b75e-c59a490ab5fa tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:49.460430 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-01628055-8eaa-4fef-b75e-c59a490ab5fa tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1213 microversion: 2.1 time: 0.067873 Aug 10 05:16:49.460893 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 109/209] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:49 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:49.567729 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-51c8387d-60ea-4684-8e63-a78530a5dad1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:49.569296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-51c8387d-60ea-4684-8e63-a78530a5dad1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:49.575667 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-51c8387d-60ea-4684-8e63-a78530a5dad1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:49.576295 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-51c8387d-60ea-4684-8e63-a78530a5dad1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:49.577226 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-51c8387d-60ea-4684-8e63-a78530a5dad1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:49.578132 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-51c8387d-60ea-4684-8e63-a78530a5dad1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:49.595371 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1dcea9e8-f6dc-4da1-882c-a2692c28dcbd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:49.599086 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1dcea9e8-f6dc-4da1-882c-a2692c28dcbd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:49.606360 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1dcea9e8-f6dc-4da1-882c-a2692c28dcbd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:49.606910 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1dcea9e8-f6dc-4da1-882c-a2692c28dcbd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:49.608225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1dcea9e8-f6dc-4da1-882c-a2692c28dcbd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:49.608661 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1dcea9e8-f6dc-4da1-882c-a2692c28dcbd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:49.658044 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-51c8387d-60ea-4684-8e63-a78530a5dad1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 27966 microversion: 2.20 time: 0.094010 Aug 10 05:16:49.661947 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 101/210] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:49 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 27966 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:16:49.697923 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1dcea9e8-f6dc-4da1-882c-a2692c28dcbd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 28223 microversion: 2.1 time: 0.106025 Aug 10 05:16:49.698731 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 110/211] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:49 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 28223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:16:49.848179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-57157fad-cab1-4d79-8b82-f61d73d5e42c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:49.848884 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-57157fad-cab1-4d79-8b82-f61d73d5e42c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:49.855337 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-57157fad-cab1-4d79-8b82-f61d73d5e42c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:49.855795 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-57157fad-cab1-4d79-8b82-f61d73d5e42c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:49.861136 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-57157fad-cab1-4d79-8b82-f61d73d5e42c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:49.861608 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-57157fad-cab1-4d79-8b82-f61d73d5e42c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:49.988356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-57157fad-cab1-4d79-8b82-f61d73d5e42c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:49.996356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-57157fad-cab1-4d79-8b82-f61d73d5e42c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.151850 Aug 10 05:16:49.997031 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 102/212] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:49 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:50.477424 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-902f4d39-ae73-46b1-a074-41b3f5cee88e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:50.478123 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-902f4d39-ae73-46b1-a074-41b3f5cee88e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:50.485624 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-902f4d39-ae73-46b1-a074-41b3f5cee88e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:50.486072 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-902f4d39-ae73-46b1-a074-41b3f5cee88e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:50.486878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-902f4d39-ae73-46b1-a074-41b3f5cee88e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:50.487307 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-902f4d39-ae73-46b1-a074-41b3f5cee88e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:50.547739 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-902f4d39-ae73-46b1-a074-41b3f5cee88e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:50.555168 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-902f4d39-ae73-46b1-a074-41b3f5cee88e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1217 microversion: 2.1 time: 0.081777 Aug 10 05:16:50.555766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 111/213] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:50 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:50.669389 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-23d649b2-2693-4614-98a6-d0b74522885a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:50.670927 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-23d649b2-2693-4614-98a6-d0b74522885a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:50.676657 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-23d649b2-2693-4614-98a6-d0b74522885a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:50.677229 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-23d649b2-2693-4614-98a6-d0b74522885a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:50.678000 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-23d649b2-2693-4614-98a6-d0b74522885a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:50.678426 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-23d649b2-2693-4614-98a6-d0b74522885a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:50.709745 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5b83d7ee-3c5c-4d89-a7ae-12faf282d57b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:50.710719 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5b83d7ee-3c5c-4d89-a7ae-12faf282d57b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:50.716639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5b83d7ee-3c5c-4d89-a7ae-12faf282d57b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:50.717078 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5b83d7ee-3c5c-4d89-a7ae-12faf282d57b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:50.717835 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5b83d7ee-3c5c-4d89-a7ae-12faf282d57b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:50.718263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5b83d7ee-3c5c-4d89-a7ae-12faf282d57b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:52.923849 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-23d649b2-2693-4614-98a6-d0b74522885a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28018 microversion: 2.20 time: 2.258172 Aug 10 05:16:52.924508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 103/214] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:50 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28018 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:52.929164 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9176cf3c-79ee-4b9e-ac12-7757ceefe1d8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:52.929847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9176cf3c-79ee-4b9e-ac12-7757ceefe1d8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:52.936302 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9176cf3c-79ee-4b9e-ac12-7757ceefe1d8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:52.936748 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9176cf3c-79ee-4b9e-ac12-7757ceefe1d8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:52.937700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9176cf3c-79ee-4b9e-ac12-7757ceefe1d8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:52.937923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9176cf3c-79ee-4b9e-ac12-7757ceefe1d8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:52.940256 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5b83d7ee-3c5c-4d89-a7ae-12faf282d57b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 28223 microversion: 2.1 time: 2.234103 Aug 10 05:16:52.940939 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 112/215] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:50 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 28223 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:16:52.947121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5469a6c6-bcb9-407f-a7df-e285ddfbdc2b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:52.947843 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5469a6c6-bcb9-407f-a7df-e285ddfbdc2b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:52.954417 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5469a6c6-bcb9-407f-a7df-e285ddfbdc2b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:52.954900 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5469a6c6-bcb9-407f-a7df-e285ddfbdc2b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:52.955675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5469a6c6-bcb9-407f-a7df-e285ddfbdc2b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:52.962240 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5469a6c6-bcb9-407f-a7df-e285ddfbdc2b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:53.042958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5469a6c6-bcb9-407f-a7df-e285ddfbdc2b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:53.052621 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5469a6c6-bcb9-407f-a7df-e285ddfbdc2b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1217 microversion: 2.1 time: 0.109641 Aug 10 05:16:53.053823 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 113/216] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:52 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:53.078665 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9176cf3c-79ee-4b9e-ac12-7757ceefe1d8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:53.086121 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9176cf3c-79ee-4b9e-ac12-7757ceefe1d8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.160536 Aug 10 05:16:53.086793 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 104/217] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:52 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:53.936235 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-52812f57-dfef-45a3-b9e6-f128b70dd93b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:53.937148 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-52812f57-dfef-45a3-b9e6-f128b70dd93b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:53.942991 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52812f57-dfef-45a3-b9e6-f128b70dd93b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:53.943577 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52812f57-dfef-45a3-b9e6-f128b70dd93b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:53.944179 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52812f57-dfef-45a3-b9e6-f128b70dd93b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:53.944610 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52812f57-dfef-45a3-b9e6-f128b70dd93b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:53.952093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3ec6c211-f431-471d-b148-cd3393a9ce6d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:53.953262 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3ec6c211-f431-471d-b148-cd3393a9ce6d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:53.960678 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3ec6c211-f431-471d-b148-cd3393a9ce6d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:53.960678 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3ec6c211-f431-471d-b148-cd3393a9ce6d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:53.960969 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3ec6c211-f431-471d-b148-cd3393a9ce6d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:53.961666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3ec6c211-f431-471d-b148-cd3393a9ce6d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:54.026097 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-52812f57-dfef-45a3-b9e6-f128b70dd93b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28199 microversion: 2.20 time: 0.093594 Aug 10 05:16:54.031373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 114/218] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:53 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:54.037771 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3ec6c211-f431-471d-b148-cd3393a9ce6d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 28223 microversion: 2.1 time: 0.089218 Aug 10 05:16:54.041677 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 105/219] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:53 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 28223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:54.069547 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-97eb9d86-fb03-49d5-9345-a26a95f21d26 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:54.070200 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-97eb9d86-fb03-49d5-9345-a26a95f21d26 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:54.077610 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97eb9d86-fb03-49d5-9345-a26a95f21d26 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:54.078516 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97eb9d86-fb03-49d5-9345-a26a95f21d26 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:54.078913 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97eb9d86-fb03-49d5-9345-a26a95f21d26 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:54.079362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97eb9d86-fb03-49d5-9345-a26a95f21d26 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:54.104491 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2bb7ab66-8104-43f3-ac98-6e3ebf925d7c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:54.105216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2bb7ab66-8104-43f3-ac98-6e3ebf925d7c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:54.111848 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2bb7ab66-8104-43f3-ac98-6e3ebf925d7c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:54.112536 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2bb7ab66-8104-43f3-ac98-6e3ebf925d7c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:54.113566 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2bb7ab66-8104-43f3-ac98-6e3ebf925d7c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:54.114005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2bb7ab66-8104-43f3-ac98-6e3ebf925d7c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:54.144364 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-97eb9d86-fb03-49d5-9345-a26a95f21d26 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:54.152645 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-97eb9d86-fb03-49d5-9345-a26a95f21d26 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1265 microversion: 2.1 time: 0.087088 Aug 10 05:16:54.164369 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 115/220] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:54 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:54.240317 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2bb7ab66-8104-43f3-ac98-6e3ebf925d7c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:54.247800 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2bb7ab66-8104-43f3-ac98-6e3ebf925d7c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.147316 Aug 10 05:16:54.248455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 106/221] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:54 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:16:55.038601 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4bf4fbcb-28d4-4efb-8401-a57c1d760ea1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:55.039559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4bf4fbcb-28d4-4efb-8401-a57c1d760ea1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:55.046662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4bf4fbcb-28d4-4efb-8401-a57c1d760ea1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:55.047408 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4bf4fbcb-28d4-4efb-8401-a57c1d760ea1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:55.048219 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4bf4fbcb-28d4-4efb-8401-a57c1d760ea1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:55.048675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4bf4fbcb-28d4-4efb-8401-a57c1d760ea1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:55.049654 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bcb67e5a-7322-4bf7-8e9f-289081c7fed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:55.050642 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bcb67e5a-7322-4bf7-8e9f-289081c7fed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:55.056577 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bcb67e5a-7322-4bf7-8e9f-289081c7fed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:55.057028 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bcb67e5a-7322-4bf7-8e9f-289081c7fed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:55.057794 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bcb67e5a-7322-4bf7-8e9f-289081c7fed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:55.058228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bcb67e5a-7322-4bf7-8e9f-289081c7fed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:58.151968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4bf4fbcb-28d4-4efb-8401-a57c1d760ea1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28199 microversion: 2.20 time: 3.116960 Aug 10 05:16:58.152614 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 116/222] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:55 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28199 bytes in 3118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:16:58.157713 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3d1eef9c-1889-49de-a015-8dac842b4089 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:58.158411 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3d1eef9c-1889-49de-a015-8dac842b4089 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:58.165158 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3d1eef9c-1889-49de-a015-8dac842b4089 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:58.165608 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3d1eef9c-1889-49de-a015-8dac842b4089 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:58.171121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3d1eef9c-1889-49de-a015-8dac842b4089 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:58.171257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bcb67e5a-7322-4bf7-8e9f-289081c7fed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 28514 microversion: 2.1 time: 3.120311 Aug 10 05:16:58.171696 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3d1eef9c-1889-49de-a015-8dac842b4089 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:58.171791 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 107/223] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:55 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 28514 bytes in 3122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:16:58.172480 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d557befd-63ca-4092-8700-ac74c89797d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:16:58.174628 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d557befd-63ca-4092-8700-ac74c89797d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:58.187044 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d557befd-63ca-4092-8700-ac74c89797d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:58.187647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d557befd-63ca-4092-8700-ac74c89797d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:58.188648 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d557befd-63ca-4092-8700-ac74c89797d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:58.189087 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d557befd-63ca-4092-8700-ac74c89797d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:58.332165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3d1eef9c-1889-49de-a015-8dac842b4089 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:58.346612 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3d1eef9c-1889-49de-a015-8dac842b4089 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.192748 Aug 10 05:16:58.347193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 117/224] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:58 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:58.473419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d557befd-63ca-4092-8700-ac74c89797d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:16:58.481683 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d557befd-63ca-4092-8700-ac74c89797d1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.313401 Aug 10 05:16:58.483376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 108/225] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:16:58 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:16:58.995587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-9b546a28-515e-4e1b-b8bf-97e02959ca6c req-ba17e35d-dbd8-4d0e-ae3f-1091b42d1c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd56c33-352c-4e62-bf97-d25e0c721f7f", "tag": "9d341ce6-feb6-4f73-92b3-b04175eaa1c9"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:58.997151 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:16:58.997151 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:16:59.004859 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-9b546a28-515e-4e1b-b8bf-97e02959ca6c req-ba17e35d-dbd8-4d0e-ae3f-1091b42d1c5d service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:59.005298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-9b546a28-515e-4e1b-b8bf-97e02959ca6c req-ba17e35d-dbd8-4d0e-ae3f-1091b42d1c5d service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:59.018113 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-9b546a28-515e-4e1b-b8bf-97e02959ca6c req-ba17e35d-dbd8-4d0e-ae3f-1091b42d1c5d service nova] Creating event network-changed:9d341ce6-feb6-4f73-92b3-b04175eaa1c9 for instance 5dd56c33-352c-4e62-bf97-d25e0c721f7f on hv-cinder-80390 Aug 10 05:16:59.022795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-9b546a28-515e-4e1b-b8bf-97e02959ca6c req-ba17e35d-dbd8-4d0e-ae3f-1091b42d1c5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030889 Aug 10 05:16:59.023405 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 118/226] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:16:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:16:59.164213 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-78bb5ca0-69aa-446c-8504-f22ae43b0e2c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:59.165127 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-78bb5ca0-69aa-446c-8504-f22ae43b0e2c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:59.171369 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-78bb5ca0-69aa-446c-8504-f22ae43b0e2c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:59.171951 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-78bb5ca0-69aa-446c-8504-f22ae43b0e2c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:59.172746 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-78bb5ca0-69aa-446c-8504-f22ae43b0e2c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:59.173184 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-78bb5ca0-69aa-446c-8504-f22ae43b0e2c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:59.180546 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-430ccbb9-631e-4f54-9cd5-c21bcde7a65b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:16:59.181694 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-430ccbb9-631e-4f54-9cd5-c21bcde7a65b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:16:59.189891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-430ccbb9-631e-4f54-9cd5-c21bcde7a65b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:59.190343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-430ccbb9-631e-4f54-9cd5-c21bcde7a65b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:16:59.191443 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-430ccbb9-631e-4f54-9cd5-c21bcde7a65b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:16:59.192165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-430ccbb9-631e-4f54-9cd5-c21bcde7a65b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:01.896483 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-78bb5ca0-69aa-446c-8504-f22ae43b0e2c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28199 microversion: 2.20 time: 2.735952 Aug 10 05:17:01.897274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 109/227] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:16:59 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28199 bytes in 2738 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:01.902286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f0f415b1-f7a5-4ae5-adf4-b2af76d25644 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:01.907121 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f0f415b1-f7a5-4ae5-adf4-b2af76d25644 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:01.910432 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f0f415b1-f7a5-4ae5-adf4-b2af76d25644 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:01.910927 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f0f415b1-f7a5-4ae5-adf4-b2af76d25644 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:01.911766 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f0f415b1-f7a5-4ae5-adf4-b2af76d25644 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:01.911898 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-430ccbb9-631e-4f54-9cd5-c21bcde7a65b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29027 microversion: 2.1 time: 2.736308 Aug 10 05:17:01.912381 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f0f415b1-f7a5-4ae5-adf4-b2af76d25644 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:01.916157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 119/228] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:16:59 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29027 bytes in 2738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:01.917672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2745e8c2-309c-45b0-9813-4fd71411146a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:01.918375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2745e8c2-309c-45b0-9813-4fd71411146a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:01.925716 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2745e8c2-309c-45b0-9813-4fd71411146a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:01.926307 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2745e8c2-309c-45b0-9813-4fd71411146a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:01.927500 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2745e8c2-309c-45b0-9813-4fd71411146a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:01.928321 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2745e8c2-309c-45b0-9813-4fd71411146a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:02.102878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2745e8c2-309c-45b0-9813-4fd71411146a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:02.102878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2745e8c2-309c-45b0-9813-4fd71411146a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.150598 Aug 10 05:17:02.102878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 120/229] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:01 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:02.417545 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f0f415b1-f7a5-4ae5-adf4-b2af76d25644 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:02.425792 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f0f415b1-f7a5-4ae5-adf4-b2af76d25644 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.527249 Aug 10 05:17:02.427989 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 110/230] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:01 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:02.909355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-fa23412a-bb56-49c9-8f0e-755d5c2d3d60 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:02.910266 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-fa23412a-bb56-49c9-8f0e-755d5c2d3d60 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:02.916755 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fa23412a-bb56-49c9-8f0e-755d5c2d3d60 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:02.917869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fa23412a-bb56-49c9-8f0e-755d5c2d3d60 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:02.918894 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fa23412a-bb56-49c9-8f0e-755d5c2d3d60 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:02.919483 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fa23412a-bb56-49c9-8f0e-755d5c2d3d60 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:02.928098 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b9c33a0c-c2cc-4896-a664-1b233da0f4ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:02.929260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b9c33a0c-c2cc-4896-a664-1b233da0f4ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:02.936056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b9c33a0c-c2cc-4896-a664-1b233da0f4ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:02.936964 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b9c33a0c-c2cc-4896-a664-1b233da0f4ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:02.938056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b9c33a0c-c2cc-4896-a664-1b233da0f4ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:02.938953 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b9c33a0c-c2cc-4896-a664-1b233da0f4ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:03.048781 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-fa23412a-bb56-49c9-8f0e-755d5c2d3d60 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28341 microversion: 2.20 time: 0.143960 Aug 10 05:17:03.049495 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 121/231] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:02 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28341 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:03.057676 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b9c33a0c-c2cc-4896-a664-1b233da0f4ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 0.137123 Aug 10 05:17:03.062484 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 111/232] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:02 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:03.082834 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e5e11765-847e-4444-9107-3b6bebafe36b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:03.083518 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e5e11765-847e-4444-9107-3b6bebafe36b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:03.095785 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e5e11765-847e-4444-9107-3b6bebafe36b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:03.095785 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e5e11765-847e-4444-9107-3b6bebafe36b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:03.095785 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e5e11765-847e-4444-9107-3b6bebafe36b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:03.095785 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e5e11765-847e-4444-9107-3b6bebafe36b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:03.222934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-e5e11765-847e-4444-9107-3b6bebafe36b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:03.230631 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e5e11765-847e-4444-9107-3b6bebafe36b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1522 microversion: 2.1 time: 0.152397 Aug 10 05:17:03.231342 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 122/233] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:03 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:03.443034 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e4c96d23-03ef-4c85-9fcf-4286de9d1bb2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:03.443732 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e4c96d23-03ef-4c85-9fcf-4286de9d1bb2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:03.450431 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e4c96d23-03ef-4c85-9fcf-4286de9d1bb2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:03.450927 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e4c96d23-03ef-4c85-9fcf-4286de9d1bb2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:03.451698 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e4c96d23-03ef-4c85-9fcf-4286de9d1bb2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:03.452136 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e4c96d23-03ef-4c85-9fcf-4286de9d1bb2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:03.574296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e4c96d23-03ef-4c85-9fcf-4286de9d1bb2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:03.582211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e4c96d23-03ef-4c85-9fcf-4286de9d1bb2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.143199 Aug 10 05:17:03.582812 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 112/234] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:03 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:04.071849 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6a64b242-250e-4ac0-9953-4d5f6abf126e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:04.072852 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6a64b242-250e-4ac0-9953-4d5f6abf126e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:04.077970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e2ec3ffc-3f02-4a03-94c7-91aff973072a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:04.078929 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e2ec3ffc-3f02-4a03-94c7-91aff973072a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:04.084624 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6a64b242-250e-4ac0-9953-4d5f6abf126e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.089173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e2ec3ffc-3f02-4a03-94c7-91aff973072a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.089758 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6a64b242-250e-4ac0-9953-4d5f6abf126e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.089864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e2ec3ffc-3f02-4a03-94c7-91aff973072a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.089959 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6a64b242-250e-4ac0-9953-4d5f6abf126e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.090050 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e2ec3ffc-3f02-4a03-94c7-91aff973072a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.090151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6a64b242-250e-4ac0-9953-4d5f6abf126e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.090249 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e2ec3ffc-3f02-4a03-94c7-91aff973072a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.179253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e2ec3ffc-3f02-4a03-94c7-91aff973072a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28488 microversion: 2.20 time: 0.119901 Aug 10 05:17:04.179900 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 123/235] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:04 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28488 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:04.194087 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6a64b242-250e-4ac0-9953-4d5f6abf126e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 0.125695 Aug 10 05:17:04.194745 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 113/236] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:04 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:04.248570 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5d69d2f3-d440-46a1-aaff-059a30e03e2d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:04.249285 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5d69d2f3-d440-46a1-aaff-059a30e03e2d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:04.255730 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d69d2f3-d440-46a1-aaff-059a30e03e2d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.256168 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d69d2f3-d440-46a1-aaff-059a30e03e2d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.256926 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d69d2f3-d440-46a1-aaff-059a30e03e2d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.257353 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d69d2f3-d440-46a1-aaff-059a30e03e2d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.385153 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5d69d2f3-d440-46a1-aaff-059a30e03e2d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:04.392901 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5d69d2f3-d440-46a1-aaff-059a30e03e2d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1502 microversion: 2.1 time: 0.148348 Aug 10 05:17:04.402992 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 124/237] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:04 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:04.409741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f2122bb2-3170-43ad-b575-017d5103a24f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:04.410446 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f2122bb2-3170-43ad-b575-017d5103a24f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:04.416814 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f2122bb2-3170-43ad-b575-017d5103a24f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.417269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f2122bb2-3170-43ad-b575-017d5103a24f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.418036 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f2122bb2-3170-43ad-b575-017d5103a24f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.418483 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f2122bb2-3170-43ad-b575-017d5103a24f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.561626 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f2122bb2-3170-43ad-b575-017d5103a24f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:04.568971 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f2122bb2-3170-43ad-b575-017d5103a24f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1516 microversion: 2.1 time: 0.163686 Aug 10 05:17:04.569544 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 114/238] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:04 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:04.599378 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5d417395-be77-4a11-96d9-4b4b6250f1e1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:04.600099 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5d417395-be77-4a11-96d9-4b4b6250f1e1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:04.606865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d417395-be77-4a11-96d9-4b4b6250f1e1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.607527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d417395-be77-4a11-96d9-4b4b6250f1e1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.611606 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d417395-be77-4a11-96d9-4b4b6250f1e1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:04.611606 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d417395-be77-4a11-96d9-4b4b6250f1e1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:04.749345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5d417395-be77-4a11-96d9-4b4b6250f1e1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:04.756649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5d417395-be77-4a11-96d9-4b4b6250f1e1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.160838 Aug 10 05:17:04.757214 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 125/239] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:04 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:05.190889 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9d923c40-0076-4755-af9f-82ff16a5bffd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:05.191804 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9d923c40-0076-4755-af9f-82ff16a5bffd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:05.197664 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d923c40-0076-4755-af9f-82ff16a5bffd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:05.198108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d923c40-0076-4755-af9f-82ff16a5bffd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:05.198965 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d923c40-0076-4755-af9f-82ff16a5bffd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:05.199569 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d923c40-0076-4755-af9f-82ff16a5bffd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:05.205701 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3fe90c04-6a62-4ef7-bf6d-b6ae116318e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:05.206775 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3fe90c04-6a62-4ef7-bf6d-b6ae116318e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:05.213098 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fe90c04-6a62-4ef7-bf6d-b6ae116318e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:05.213559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fe90c04-6a62-4ef7-bf6d-b6ae116318e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:05.214402 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fe90c04-6a62-4ef7-bf6d-b6ae116318e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:05.215007 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fe90c04-6a62-4ef7-bf6d-b6ae116318e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:08.782452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9d923c40-0076-4755-af9f-82ff16a5bffd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 3.594459 Aug 10 05:17:08.783051 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 115/240] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:05 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 3597 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:08.787942 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5cf069f5-b5b7-4545-b38f-37c3d4c6dd1e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:08.788631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5cf069f5-b5b7-4545-b38f-37c3d4c6dd1e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:08.794050 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3fe90c04-6a62-4ef7-bf6d-b6ae116318e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 3.591809 Aug 10 05:17:08.795071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5cf069f5-b5b7-4545-b38f-37c3d4c6dd1e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:08.795639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 126/241] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:05 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 3595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:08.795836 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5cf069f5-b5b7-4545-b38f-37c3d4c6dd1e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:08.801257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5cf069f5-b5b7-4545-b38f-37c3d4c6dd1e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:08.801257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5cf069f5-b5b7-4545-b38f-37c3d4c6dd1e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:08.933490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-5cf069f5-b5b7-4545-b38f-37c3d4c6dd1e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:08.940871 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5cf069f5-b5b7-4545-b38f-37c3d4c6dd1e tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.156721 Aug 10 05:17:08.941426 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 116/242] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:08 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:09.559802 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-05048be6-4136-4814-9590-a62848a57607 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:09.560822 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-05048be6-4136-4814-9590-a62848a57607 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:09.567752 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05048be6-4136-4814-9590-a62848a57607 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:09.568198 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05048be6-4136-4814-9590-a62848a57607 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:09.568967 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05048be6-4136-4814-9590-a62848a57607 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:09.569400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05048be6-4136-4814-9590-a62848a57607 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:09.592641 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-05048be6-4136-4814-9590-a62848a57607 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lazy-loading 'flavor' on Instance uuid 087a4339-30e4-48c7-aae6-024174e2d953 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:17:09.794819 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fddf92a9-cf52-46d2-a9a7-cc800376c8bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:09.795729 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fddf92a9-cf52-46d2-a9a7-cc800376c8bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:09.807298 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fddf92a9-cf52-46d2-a9a7-cc800376c8bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:09.811299 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fddf92a9-cf52-46d2-a9a7-cc800376c8bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:09.812347 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fddf92a9-cf52-46d2-a9a7-cc800376c8bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:09.813565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fddf92a9-cf52-46d2-a9a7-cc800376c8bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:09.889733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-05048be6-4136-4814-9590-a62848a57607 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/action" status: 200 len: 32 microversion: 2.1 time: 0.333935 Aug 10 05:17:09.890484 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 127/243] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:09 2021] POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:17:09.897832 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d607479d-2d29-4391-8f08-32af3c9a28bf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:09.899122 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d607479d-2d29-4391-8f08-32af3c9a28bf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:09.905471 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d607479d-2d29-4391-8f08-32af3c9a28bf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:09.906118 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d607479d-2d29-4391-8f08-32af3c9a28bf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:09.907738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d607479d-2d29-4391-8f08-32af3c9a28bf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:09.908172 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d607479d-2d29-4391-8f08-32af3c9a28bf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:09.919088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fddf92a9-cf52-46d2-a9a7-cc800376c8bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 0.127810 Aug 10 05:17:09.931586 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 117/244] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:09 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:09.931586 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-59d7d7f3-0ff1-48a4-bd69-c1ee6f56fb8c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:09.931586 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-59d7d7f3-0ff1-48a4-bd69-c1ee6f56fb8c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:09.932574 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-59d7d7f3-0ff1-48a4-bd69-c1ee6f56fb8c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:09.933194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-59d7d7f3-0ff1-48a4-bd69-c1ee6f56fb8c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:09.934218 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-59d7d7f3-0ff1-48a4-bd69-c1ee6f56fb8c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:09.934701 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-59d7d7f3-0ff1-48a4-bd69-c1ee6f56fb8c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:09.987396 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d607479d-2d29-4391-8f08-32af3c9a28bf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 0.094359 Aug 10 05:17:09.988324 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 128/245] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:09 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:09.999546 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e57b8269-da13-45d5-88d4-92a727f2176f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:09.999546 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e57b8269-da13-45d5-88d4-92a727f2176f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:10.002409 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e57b8269-da13-45d5-88d4-92a727f2176f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:10.002913 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e57b8269-da13-45d5-88d4-92a727f2176f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:10.003705 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e57b8269-da13-45d5-88d4-92a727f2176f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:10.004141 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e57b8269-da13-45d5-88d4-92a727f2176f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:10.123937 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-59d7d7f3-0ff1-48a4-bd69-c1ee6f56fb8c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:10.134721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-59d7d7f3-0ff1-48a4-bd69-c1ee6f56fb8c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.213171 Aug 10 05:17:10.135970 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 118/246] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:09 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:10.151071 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-e57b8269-da13-45d5-88d4-92a727f2176f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:10.159032 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e57b8269-da13-45d5-88d4-92a727f2176f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.169511 Aug 10 05:17:10.159669 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 129/247] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:09 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:10.941179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6379936b-5695-4963-8a01-2bc5fc5b9739 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:10.942267 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6379936b-5695-4963-8a01-2bc5fc5b9739 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:10.948409 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6379936b-5695-4963-8a01-2bc5fc5b9739 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:10.949140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6379936b-5695-4963-8a01-2bc5fc5b9739 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:10.949924 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6379936b-5695-4963-8a01-2bc5fc5b9739 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:10.950360 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6379936b-5695-4963-8a01-2bc5fc5b9739 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:11.005503 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ac0c34e1-0deb-4c5d-8045-6c2f9865ef95 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:11.006631 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ac0c34e1-0deb-4c5d-8045-6c2f9865ef95 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:11.013481 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ac0c34e1-0deb-4c5d-8045-6c2f9865ef95 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:11.032021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ac0c34e1-0deb-4c5d-8045-6c2f9865ef95 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:11.032021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ac0c34e1-0deb-4c5d-8045-6c2f9865ef95 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:11.032021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ac0c34e1-0deb-4c5d-8045-6c2f9865ef95 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:11.032385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6379936b-5695-4963-8a01-2bc5fc5b9739 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 0.084687 Aug 10 05:17:11.032385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 119/248] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:10 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:11.032385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-32317d9b-aaab-4fed-9e33-e34910c8893e req-a38d7513-dec3-4584-9d28-0ac7bf84e301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd56c33-352c-4e62-bf97-d25e0c721f7f", "name": "network-vif-plugged", "status": "completed", "tag": "9d341ce6-feb6-4f73-92b3-b04175eaa1c9"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:11.032385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:17:11.032385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:17:11.039843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-32317d9b-aaab-4fed-9e33-e34910c8893e req-a38d7513-dec3-4584-9d28-0ac7bf84e301 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:11.040290 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-32317d9b-aaab-4fed-9e33-e34910c8893e req-a38d7513-dec3-4584-9d28-0ac7bf84e301 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:11.052437 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-32317d9b-aaab-4fed-9e33-e34910c8893e req-a38d7513-dec3-4584-9d28-0ac7bf84e301 service nova] Creating event network-vif-plugged:9d341ce6-feb6-4f73-92b3-b04175eaa1c9 for instance 5dd56c33-352c-4e62-bf97-d25e0c721f7f on hv-cinder-80390 Aug 10 05:17:11.057391 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-32317d9b-aaab-4fed-9e33-e34910c8893e req-a38d7513-dec3-4584-9d28-0ac7bf84e301 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033082 Aug 10 05:17:11.058050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 120/249] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:17:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:17:11.091483 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ac0c34e1-0deb-4c5d-8045-6c2f9865ef95 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 0.089503 Aug 10 05:17:11.092701 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 130/250] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:11 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:11.154172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c431a545-2018-4b6e-a417-73cb36552e60 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:11.154909 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c431a545-2018-4b6e-a417-73cb36552e60 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:11.168629 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c431a545-2018-4b6e-a417-73cb36552e60 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:11.169089 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c431a545-2018-4b6e-a417-73cb36552e60 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:11.169891 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c431a545-2018-4b6e-a417-73cb36552e60 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:11.170311 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c431a545-2018-4b6e-a417-73cb36552e60 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:11.178695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-67a2d800-72be-48bd-b97a-c6762c2c1483 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:11.179516 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-67a2d800-72be-48bd-b97a-c6762c2c1483 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:11.186194 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-67a2d800-72be-48bd-b97a-c6762c2c1483 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:11.186832 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-67a2d800-72be-48bd-b97a-c6762c2c1483 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:11.187672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-67a2d800-72be-48bd-b97a-c6762c2c1483 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:11.188102 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-67a2d800-72be-48bd-b97a-c6762c2c1483 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:11.332233 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c431a545-2018-4b6e-a417-73cb36552e60 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:11.340104 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c431a545-2018-4b6e-a417-73cb36552e60 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.190529 Aug 10 05:17:11.341059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 121/251] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:11 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:11.346353 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-67a2d800-72be-48bd-b97a-c6762c2c1483 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:11.353796 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-67a2d800-72be-48bd-b97a-c6762c2c1483 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.180586 Aug 10 05:17:11.354356 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 131/252] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:11 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:12.034018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5b976eed-9c7a-4e76-b020-ffddf36d3418 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:12.035031 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5b976eed-9c7a-4e76-b020-ffddf36d3418 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:12.041493 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5b976eed-9c7a-4e76-b020-ffddf36d3418 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:12.042098 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5b976eed-9c7a-4e76-b020-ffddf36d3418 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:12.042986 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5b976eed-9c7a-4e76-b020-ffddf36d3418 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:12.043425 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5b976eed-9c7a-4e76-b020-ffddf36d3418 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:12.103889 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-27916b44-9fa9-42b9-8630-a1bc29304ea4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:12.104789 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-27916b44-9fa9-42b9-8630-a1bc29304ea4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:12.113650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-27916b44-9fa9-42b9-8630-a1bc29304ea4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:12.114458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-27916b44-9fa9-42b9-8630-a1bc29304ea4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:12.115330 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-27916b44-9fa9-42b9-8630-a1bc29304ea4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:12.115842 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-27916b44-9fa9-42b9-8630-a1bc29304ea4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:12.123803 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5b976eed-9c7a-4e76-b020-ffddf36d3418 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 0.093703 Aug 10 05:17:12.124760 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 122/253] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:12 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:12.194562 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-27916b44-9fa9-42b9-8630-a1bc29304ea4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 0.094147 Aug 10 05:17:12.197770 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 132/254] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:12 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:12.358967 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6fd1f01c-4d9a-49d8-adaa-9031d0abbba2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:12.359746 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6fd1f01c-4d9a-49d8-adaa-9031d0abbba2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:12.366811 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fd1f01c-4d9a-49d8-adaa-9031d0abbba2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:12.368185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fd1f01c-4d9a-49d8-adaa-9031d0abbba2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:12.368450 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fd1f01c-4d9a-49d8-adaa-9031d0abbba2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:12.369038 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fd1f01c-4d9a-49d8-adaa-9031d0abbba2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:12.371872 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0eefeba5-8c1f-48a4-a6db-fc067c439a00 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:12.372866 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0eefeba5-8c1f-48a4-a6db-fc067c439a00 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:12.380944 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0eefeba5-8c1f-48a4-a6db-fc067c439a00 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:12.381692 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0eefeba5-8c1f-48a4-a6db-fc067c439a00 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:12.382813 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0eefeba5-8c1f-48a4-a6db-fc067c439a00 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:12.383489 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0eefeba5-8c1f-48a4-a6db-fc067c439a00 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:12.512600 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6fd1f01c-4d9a-49d8-adaa-9031d0abbba2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:12.525760 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0eefeba5-8c1f-48a4-a6db-fc067c439a00 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:12.526278 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6fd1f01c-4d9a-49d8-adaa-9031d0abbba2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.165836 Aug 10 05:17:12.526278 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 123/255] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:12 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:12.535860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0eefeba5-8c1f-48a4-a6db-fc067c439a00 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.169005 Aug 10 05:17:12.536526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 133/256] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:12 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:13.135279 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5aad3bc7-48a8-4235-8fe3-9b1c03e3d67d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:13.136193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5aad3bc7-48a8-4235-8fe3-9b1c03e3d67d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:13.143885 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5aad3bc7-48a8-4235-8fe3-9b1c03e3d67d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:13.144510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5aad3bc7-48a8-4235-8fe3-9b1c03e3d67d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:13.145704 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5aad3bc7-48a8-4235-8fe3-9b1c03e3d67d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:13.146288 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5aad3bc7-48a8-4235-8fe3-9b1c03e3d67d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:13.205732 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c6e3be23-f6cd-4cc6-9017-e3e73b175ca1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:13.207295 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c6e3be23-f6cd-4cc6-9017-e3e73b175ca1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:13.216254 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c6e3be23-f6cd-4cc6-9017-e3e73b175ca1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:13.216254 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c6e3be23-f6cd-4cc6-9017-e3e73b175ca1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:13.216254 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c6e3be23-f6cd-4cc6-9017-e3e73b175ca1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:13.216254 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c6e3be23-f6cd-4cc6-9017-e3e73b175ca1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:15.931428 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5aad3bc7-48a8-4235-8fe3-9b1c03e3d67d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 2.799755 Aug 10 05:17:15.935579 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 124/257] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:13 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 2801 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:15.936771 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8566e535-b6b7-4161-82ee-4d95e4fa04bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:15.937466 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8566e535-b6b7-4161-82ee-4d95e4fa04bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:15.944464 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8566e535-b6b7-4161-82ee-4d95e4fa04bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:15.944919 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8566e535-b6b7-4161-82ee-4d95e4fa04bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:15.945683 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8566e535-b6b7-4161-82ee-4d95e4fa04bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:15.946124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8566e535-b6b7-4161-82ee-4d95e4fa04bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:15.975858 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c6e3be23-f6cd-4cc6-9017-e3e73b175ca1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 2.774253 Aug 10 05:17:15.976501 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 134/258] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:13 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 2776 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:15.981347 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-121bb487-3868-4042-8f5c-2793bd38757f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:15.982032 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-121bb487-3868-4042-8f5c-2793bd38757f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:15.989517 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-121bb487-3868-4042-8f5c-2793bd38757f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:15.989974 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-121bb487-3868-4042-8f5c-2793bd38757f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:15.990778 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-121bb487-3868-4042-8f5c-2793bd38757f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:15.991206 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-121bb487-3868-4042-8f5c-2793bd38757f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:16.076688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8566e535-b6b7-4161-82ee-4d95e4fa04bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:16.084173 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8566e535-b6b7-4161-82ee-4d95e4fa04bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.151038 Aug 10 05:17:16.084839 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 125/259] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:15 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:16.132434 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-121bb487-3868-4042-8f5c-2793bd38757f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:16.132799 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-121bb487-3868-4042-8f5c-2793bd38757f tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1313 microversion: 2.1 time: 0.155164 Aug 10 05:17:16.133353 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 135/260] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:15 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:16.943592 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-60ce9bbc-5a69-4cbd-8dcf-9e583f8daa80 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:16.944499 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-60ce9bbc-5a69-4cbd-8dcf-9e583f8daa80 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:16.950812 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-60ce9bbc-5a69-4cbd-8dcf-9e583f8daa80 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:16.951259 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-60ce9bbc-5a69-4cbd-8dcf-9e583f8daa80 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:16.954217 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-60ce9bbc-5a69-4cbd-8dcf-9e583f8daa80 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:16.954217 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-60ce9bbc-5a69-4cbd-8dcf-9e583f8daa80 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:16.987474 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f74e231e-910a-4eda-a3d4-336b02c9b42e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:16.989275 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f74e231e-910a-4eda-a3d4-336b02c9b42e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:16.995577 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f74e231e-910a-4eda-a3d4-336b02c9b42e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:16.996022 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f74e231e-910a-4eda-a3d4-336b02c9b42e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:16.996785 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f74e231e-910a-4eda-a3d4-336b02c9b42e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:16.997217 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f74e231e-910a-4eda-a3d4-336b02c9b42e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:17.040075 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-60ce9bbc-5a69-4cbd-8dcf-9e583f8daa80 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 0.100077 Aug 10 05:17:17.040644 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 126/261] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:16 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:17.077269 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f74e231e-910a-4eda-a3d4-336b02c9b42e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 0.093291 Aug 10 05:17:17.077940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 136/262] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:16 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:17.101073 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-52fb2f27-e83a-4e0c-9495-75bedd774b3b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:17.101799 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-52fb2f27-e83a-4e0c-9495-75bedd774b3b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:17.108796 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-52fb2f27-e83a-4e0c-9495-75bedd774b3b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:17.109258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-52fb2f27-e83a-4e0c-9495-75bedd774b3b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:17.114890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-52fb2f27-e83a-4e0c-9495-75bedd774b3b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:17.114890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-52fb2f27-e83a-4e0c-9495-75bedd774b3b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:17.149378 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-90134cca-eda3-4766-b4e3-fdbd73d1cea2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:17.150081 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-90134cca-eda3-4766-b4e3-fdbd73d1cea2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:17.157329 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-90134cca-eda3-4766-b4e3-fdbd73d1cea2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:17.157783 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-90134cca-eda3-4766-b4e3-fdbd73d1cea2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:17.158552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-90134cca-eda3-4766-b4e3-fdbd73d1cea2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:17.159011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-90134cca-eda3-4766-b4e3-fdbd73d1cea2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:17.250710 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-52fb2f27-e83a-4e0c-9495-75bedd774b3b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:17.264250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-52fb2f27-e83a-4e0c-9495-75bedd774b3b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.167134 Aug 10 05:17:17.265364 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 127/263] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:17 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:17.314135 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-90134cca-eda3-4766-b4e3-fdbd73d1cea2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:17.325791 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-90134cca-eda3-4766-b4e3-fdbd73d1cea2 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1497 microversion: 2.1 time: 0.177097 Aug 10 05:17:17.331124 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 137/264] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:17 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:18.052005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7c600da8-6706-43ce-800a-4cdb8b1645a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:18.058637 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7c600da8-6706-43ce-800a-4cdb8b1645a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:18.058637 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7c600da8-6706-43ce-800a-4cdb8b1645a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:18.059081 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7c600da8-6706-43ce-800a-4cdb8b1645a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:18.059858 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7c600da8-6706-43ce-800a-4cdb8b1645a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:18.060296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7c600da8-6706-43ce-800a-4cdb8b1645a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:18.090735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-91df2cc8-767b-46a3-9017-6543cad14bc1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:18.094789 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-91df2cc8-767b-46a3-9017-6543cad14bc1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:18.097449 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-91df2cc8-767b-46a3-9017-6543cad14bc1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:18.097905 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-91df2cc8-767b-46a3-9017-6543cad14bc1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:18.098704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-91df2cc8-767b-46a3-9017-6543cad14bc1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:18.099139 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-91df2cc8-767b-46a3-9017-6543cad14bc1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:18.133644 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7c600da8-6706-43ce-800a-4cdb8b1645a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 0.085042 Aug 10 05:17:18.134315 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 128/265] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:18 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:18.169984 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-91df2cc8-767b-46a3-9017-6543cad14bc1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 0.082963 Aug 10 05:17:18.170807 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 138/266] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:18 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:18.281465 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0ecf008a-e545-45f5-a305-2298c80f81c3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:18.282158 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0ecf008a-e545-45f5-a305-2298c80f81c3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:18.288542 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0ecf008a-e545-45f5-a305-2298c80f81c3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:18.288981 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0ecf008a-e545-45f5-a305-2298c80f81c3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:18.290717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0ecf008a-e545-45f5-a305-2298c80f81c3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:18.290717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0ecf008a-e545-45f5-a305-2298c80f81c3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:18.415029 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0ecf008a-e545-45f5-a305-2298c80f81c3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:18.423017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0ecf008a-e545-45f5-a305-2298c80f81c3 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.145044 Aug 10 05:17:18.428003 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 129/267] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:18 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:19.146737 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1f9c740f-1ebd-409f-af79-3347ad5809fc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:19.147772 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1f9c740f-1ebd-409f-af79-3347ad5809fc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:19.154385 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f9c740f-1ebd-409f-af79-3347ad5809fc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:19.154866 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f9c740f-1ebd-409f-af79-3347ad5809fc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:19.155646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f9c740f-1ebd-409f-af79-3347ad5809fc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:19.156080 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f9c740f-1ebd-409f-af79-3347ad5809fc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:19.189930 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-55cd9665-844b-4a27-b0b6-d8539bd38a5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:19.189930 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-55cd9665-844b-4a27-b0b6-d8539bd38a5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:19.191547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-55cd9665-844b-4a27-b0b6-d8539bd38a5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:19.191994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-55cd9665-844b-4a27-b0b6-d8539bd38a5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:19.192749 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-55cd9665-844b-4a27-b0b6-d8539bd38a5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:19.193182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-55cd9665-844b-4a27-b0b6-d8539bd38a5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:21.265218 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1f9c740f-1ebd-409f-af79-3347ad5809fc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 2.122406 Aug 10 05:17:21.265934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 139/268] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:19 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:21.270888 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-19cc95e7-29d3-426a-8680-2fa8e916e96e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:21.271654 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-19cc95e7-29d3-426a-8680-2fa8e916e96e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:21.279216 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-19cc95e7-29d3-426a-8680-2fa8e916e96e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:21.279731 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-19cc95e7-29d3-426a-8680-2fa8e916e96e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:21.280059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-55cd9665-844b-4a27-b0b6-d8539bd38a5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 2.099364 Aug 10 05:17:21.280523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-19cc95e7-29d3-426a-8680-2fa8e916e96e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:21.284495 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-19cc95e7-29d3-426a-8680-2fa8e916e96e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:21.284634 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 130/269] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:19 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:21.401712 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-19cc95e7-29d3-426a-8680-2fa8e916e96e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:21.409528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-19cc95e7-29d3-426a-8680-2fa8e916e96e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.142356 Aug 10 05:17:21.410092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 140/270] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:21 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:21.800250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5fb0e515-5161-47ad-968b-8b46dbf25477 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:21.800859 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5fb0e515-5161-47ad-968b-8b46dbf25477 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:21.807529 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5fb0e515-5161-47ad-968b-8b46dbf25477 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:21.807978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5fb0e515-5161-47ad-968b-8b46dbf25477 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:21.808756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5fb0e515-5161-47ad-968b-8b46dbf25477 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:21.809192 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5fb0e515-5161-47ad-968b-8b46dbf25477 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:21.837166 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5fb0e515-5161-47ad-968b-8b46dbf25477 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Going to try to terminate instance {{(pid=108137) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:17:22.152021 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5fb0e515-5161-47ad-968b-8b46dbf25477 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 204 len: 0 microversion: 2.1 time: 0.356079 Aug 10 05:17:22.152535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 131/271] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:17:21 2021] DELETE /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:17:22.162343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d9757c6a-6a80-4f7a-97ff-e3962b318ee1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:22.163154 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d9757c6a-6a80-4f7a-97ff-e3962b318ee1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:22.169159 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d9757c6a-6a80-4f7a-97ff-e3962b318ee1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:22.169603 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d9757c6a-6a80-4f7a-97ff-e3962b318ee1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:22.170370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d9757c6a-6a80-4f7a-97ff-e3962b318ee1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:22.171004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d9757c6a-6a80-4f7a-97ff-e3962b318ee1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:22.277411 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d5453a60-6c56-4dff-b8d2-a2f5ab0faaab tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:22.278433 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d5453a60-6c56-4dff-b8d2-a2f5ab0faaab tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:22.284961 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d5453a60-6c56-4dff-b8d2-a2f5ab0faaab tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:22.285551 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d5453a60-6c56-4dff-b8d2-a2f5ab0faaab tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:22.287778 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d5453a60-6c56-4dff-b8d2-a2f5ab0faaab tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:22.288229 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d5453a60-6c56-4dff-b8d2-a2f5ab0faaab tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:22.295270 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d9757c6a-6a80-4f7a-97ff-e3962b318ee1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:22.302589 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d9757c6a-6a80-4f7a-97ff-e3962b318ee1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1503 microversion: 2.1 time: 0.145638 Aug 10 05:17:22.303228 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 141/272] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:22 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:22.307544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a1dfa738-28c8-43b6-af71-24d731ad99ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:22.308448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a1dfa738-28c8-43b6-af71-24d731ad99ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:22.314282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a1dfa738-28c8-43b6-af71-24d731ad99ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:22.314784 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a1dfa738-28c8-43b6-af71-24d731ad99ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:22.315679 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a1dfa738-28c8-43b6-af71-24d731ad99ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:22.316114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a1dfa738-28c8-43b6-af71-24d731ad99ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:22.361201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d5453a60-6c56-4dff-b8d2-a2f5ab0faaab tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 0.087608 Aug 10 05:17:22.361901 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 132/273] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:22 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:22.387428 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a1dfa738-28c8-43b6-af71-24d731ad99ab tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 29285 microversion: 2.1 time: 0.083006 Aug 10 05:17:22.388091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 142/274] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:22 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 29285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:22.426308 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a217bb8c-6d04-4ccc-b3a3-51ccddb0d67e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:22.426978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a217bb8c-6d04-4ccc-b3a3-51ccddb0d67e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:22.433471 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a217bb8c-6d04-4ccc-b3a3-51ccddb0d67e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:22.433923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a217bb8c-6d04-4ccc-b3a3-51ccddb0d67e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:22.434719 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a217bb8c-6d04-4ccc-b3a3-51ccddb0d67e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:22.435160 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a217bb8c-6d04-4ccc-b3a3-51ccddb0d67e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:22.697645 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a217bb8c-6d04-4ccc-b3a3-51ccddb0d67e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:22.705985 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a217bb8c-6d04-4ccc-b3a3-51ccddb0d67e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.283643 Aug 10 05:17:22.706546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 133/275] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:22 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:23.323519 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-150ab62c-082b-4d8d-8e02-1557aa9c494a tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:23.328478 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-150ab62c-082b-4d8d-8e02-1557aa9c494a tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:23.331390 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-150ab62c-082b-4d8d-8e02-1557aa9c494a tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:23.331837 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-150ab62c-082b-4d8d-8e02-1557aa9c494a tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:23.332629 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-150ab62c-082b-4d8d-8e02-1557aa9c494a tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:23.333056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-150ab62c-082b-4d8d-8e02-1557aa9c494a tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:23.373083 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2156eec2-7729-4397-870a-90a114ccaa21 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:23.374043 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2156eec2-7729-4397-870a-90a114ccaa21 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:23.380126 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2156eec2-7729-4397-870a-90a114ccaa21 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:23.380582 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2156eec2-7729-4397-870a-90a114ccaa21 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:23.381635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2156eec2-7729-4397-870a-90a114ccaa21 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:23.382250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2156eec2-7729-4397-870a-90a114ccaa21 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:23.453365 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2156eec2-7729-4397-870a-90a114ccaa21 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 28656 microversion: 2.20 time: 0.083669 Aug 10 05:17:23.454407 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 134/276] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:23 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 28656 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:23.462301 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-18c4bc83-7f44-4ba1-ae61-25cb71ed8568 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:23.463806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-18c4bc83-7f44-4ba1-ae61-25cb71ed8568 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:23.473759 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-18c4bc83-7f44-4ba1-ae61-25cb71ed8568 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:23.474266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-18c4bc83-7f44-4ba1-ae61-25cb71ed8568 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:23.475014 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-18c4bc83-7f44-4ba1-ae61-25cb71ed8568 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:23.475454 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-18c4bc83-7f44-4ba1-ae61-25cb71ed8568 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:23.508669 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-150ab62c-082b-4d8d-8e02-1557aa9c494a tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:23.516276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-150ab62c-082b-4d8d-8e02-1557aa9c494a tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1503 microversion: 2.1 time: 0.199712 Aug 10 05:17:23.516493 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 143/277] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:23 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:23.557059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-18c4bc83-7f44-4ba1-ae61-25cb71ed8568 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 30450 microversion: 2.1 time: 0.100616 Aug 10 05:17:23.557768 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 135/278] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:23 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 30450 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:23.723169 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5a788d96-c6bc-4b90-9415-22b3373ffad4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:23.723814 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5a788d96-c6bc-4b90-9415-22b3373ffad4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:23.729582 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5a788d96-c6bc-4b90-9415-22b3373ffad4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:23.730037 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5a788d96-c6bc-4b90-9415-22b3373ffad4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:23.730837 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5a788d96-c6bc-4b90-9415-22b3373ffad4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:23.731282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5a788d96-c6bc-4b90-9415-22b3373ffad4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:24.081859 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5a788d96-c6bc-4b90-9415-22b3373ffad4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:24.094435 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5a788d96-c6bc-4b90-9415-22b3373ffad4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.374990 Aug 10 05:17:24.095050 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 144/279] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:23 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:24.467741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-51518074-d8fa-4229-a9fb-50ea6a42f1e7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:24.469710 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-51518074-d8fa-4229-a9fb-50ea6a42f1e7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:24.476313 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-51518074-d8fa-4229-a9fb-50ea6a42f1e7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:24.476756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-51518074-d8fa-4229-a9fb-50ea6a42f1e7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:24.477520 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-51518074-d8fa-4229-a9fb-50ea6a42f1e7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:24.477953 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-51518074-d8fa-4229-a9fb-50ea6a42f1e7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:24.543821 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-36e11389-d25c-46de-b047-7daab775963d tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:24.544568 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-36e11389-d25c-46de-b047-7daab775963d tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:24.555926 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36e11389-d25c-46de-b047-7daab775963d tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:24.555926 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36e11389-d25c-46de-b047-7daab775963d tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:24.556331 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-51518074-d8fa-4229-a9fb-50ea6a42f1e7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 29512 microversion: 2.20 time: 0.091886 Aug 10 05:17:24.556331 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 136/280] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:24 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 29512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:24.560646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36e11389-d25c-46de-b047-7daab775963d tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:24.562066 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-36e11389-d25c-46de-b047-7daab775963d tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:24.574164 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5a4f6ab9-2f6a-4853-b317-30d66d32cbc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:24.575547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5a4f6ab9-2f6a-4853-b317-30d66d32cbc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:24.584928 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a4f6ab9-2f6a-4853-b317-30d66d32cbc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:24.585554 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a4f6ab9-2f6a-4853-b317-30d66d32cbc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:24.586811 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a4f6ab9-2f6a-4853-b317-30d66d32cbc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:24.592096 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a4f6ab9-2f6a-4853-b317-30d66d32cbc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:24.642264 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-36e11389-d25c-46de-b047-7daab775963d tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:24.649849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-36e11389-d25c-46de-b047-7daab775963d tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 200 len: 1461 microversion: 2.1 time: 0.113708 Aug 10 05:17:24.650413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 145/281] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:24 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 1461 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:24.654720 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-687e87bd-9faa-4348-ab3d-d13f4ee5ddc8 req-57a99f22-c468-4c22-bc33-a3ed69214bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd56c33-352c-4e62-bf97-d25e0c721f7f", "name": "network-vif-deleted", "tag": "9d341ce6-feb6-4f73-92b3-b04175eaa1c9"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:24.656202 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:17:24.656202 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:17:24.663348 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-687e87bd-9faa-4348-ab3d-d13f4ee5ddc8 req-57a99f22-c468-4c22-bc33-a3ed69214bf5 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:24.663795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-687e87bd-9faa-4348-ab3d-d13f4ee5ddc8 req-57a99f22-c468-4c22-bc33-a3ed69214bf5 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:24.669777 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5a4f6ab9-2f6a-4853-b317-30d66d32cbc7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 31624 microversion: 2.1 time: 0.103831 Aug 10 05:17:24.670914 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 137/282] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:24 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 31624 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:24.675897 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-687e87bd-9faa-4348-ab3d-d13f4ee5ddc8 req-57a99f22-c468-4c22-bc33-a3ed69214bf5 service nova] Creating event network-vif-deleted:9d341ce6-feb6-4f73-92b3-b04175eaa1c9 for instance 5dd56c33-352c-4e62-bf97-d25e0c721f7f on hv-cinder-80390 Aug 10 05:17:24.680949 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-687e87bd-9faa-4348-ab3d-d13f4ee5ddc8 req-57a99f22-c468-4c22-bc33-a3ed69214bf5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029186 Aug 10 05:17:24.681603 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 146/283] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:17:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:17:25.112483 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1f2e3a8e-9b0a-42bc-bd81-00f854f57daf tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:25.113184 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1f2e3a8e-9b0a-42bc-bd81-00f854f57daf tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:25.120034 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1f2e3a8e-9b0a-42bc-bd81-00f854f57daf tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:25.120481 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1f2e3a8e-9b0a-42bc-bd81-00f854f57daf tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:25.121287 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1f2e3a8e-9b0a-42bc-bd81-00f854f57daf tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:25.121668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1f2e3a8e-9b0a-42bc-bd81-00f854f57daf tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:25.251222 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1f2e3a8e-9b0a-42bc-bd81-00f854f57daf tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:25.258968 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1f2e3a8e-9b0a-42bc-bd81-00f854f57daf tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.151234 Aug 10 05:17:25.259652 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 138/284] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:25 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:25.566051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d2f85c2b-6510-495a-ab94-eafeed812ee7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:25.567184 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d2f85c2b-6510-495a-ab94-eafeed812ee7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:25.573589 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d2f85c2b-6510-495a-ab94-eafeed812ee7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:25.574036 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d2f85c2b-6510-495a-ab94-eafeed812ee7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:25.574850 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d2f85c2b-6510-495a-ab94-eafeed812ee7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:25.575284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d2f85c2b-6510-495a-ab94-eafeed812ee7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:25.655678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d2f85c2b-6510-495a-ab94-eafeed812ee7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 31171 microversion: 2.20 time: 0.093540 Aug 10 05:17:25.657930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 147/285] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:25 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 31171 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:25.667085 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:25.667699 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 5dd56c33-352c-4e62-bf97-d25e0c721f7f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:25.674167 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:25.676201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:25.676201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:25.676201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:25.682194 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5ded6bf5-d1d3-481b-af53-27ea908fdcf0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:25.683225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5ded6bf5-d1d3-481b-af53-27ea908fdcf0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:25.701454 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ded6bf5-d1d3-481b-af53-27ea908fdcf0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:25.701901 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ded6bf5-d1d3-481b-af53-27ea908fdcf0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:25.702886 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ded6bf5-d1d3-481b-af53-27ea908fdcf0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:25.703397 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ded6bf5-d1d3-481b-af53-27ea908fdcf0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:25.708110 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] HTTP exception thrown: Instance 5dd56c33-352c-4e62-bf97-d25e0c721f7f could not be found. Aug 10 05:17:25.711379 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Returning 404 to user: Instance 5dd56c33-352c-4e62-bf97-d25e0c721f7f could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:17:25.712261 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-016b61cb-4130-4c6e-9ac9-948685993fe1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f" status: 404 len: 111 microversion: 2.1 time: 0.048928 Aug 10 05:17:25.713240 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 139/286] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:25 2021] GET /compute/v2.1/servers/5dd56c33-352c-4e62-bf97-d25e0c721f7f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:17:25.774848 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5ded6bf5-d1d3-481b-af53-27ea908fdcf0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 32923 microversion: 2.1 time: 0.096905 Aug 10 05:17:25.775854 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 148/287] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:25 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 32923 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:25.813988 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-294473936", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "71726d26-d4cb-4b88-b610-ac7c500ea4d2"}]}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:25.865170 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] validate_networks() for [('71726d26-d4cb-4b88-b610-ac7c500ea4d2', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:17:26.213046 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:17:26.213550 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:17:26.214018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:17:26.214421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:17:26.214862 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:17:26.224590 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:26.225039 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:26.225838 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:26.226284 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:26.242592 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Getting quotas for project 2d4061dd7eb245a69b1eff088985076c. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:17:26.246411 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Getting quotas for user 4c80843a900943ecb7d312088d9bf04b and project 2d4061dd7eb245a69b1eff088985076c. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:17:26.257600 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:17:26.260074 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:17:26.275519 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c42ba7e4-6b0f-4d39-bf05-7e2cb4235a90 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:26.276330 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c42ba7e4-6b0f-4d39-bf05-7e2cb4235a90 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:26.283073 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c42ba7e4-6b0f-4d39-bf05-7e2cb4235a90 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:26.283526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c42ba7e4-6b0f-4d39-bf05-7e2cb4235a90 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:26.284333 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c42ba7e4-6b0f-4d39-bf05-7e2cb4235a90 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:26.284769 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c42ba7e4-6b0f-4d39-bf05-7e2cb4235a90 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:26.442177 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c42ba7e4-6b0f-4d39-bf05-7e2cb4235a90 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:26.449700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c42ba7e4-6b0f-4d39-bf05-7e2cb4235a90 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.178408 Aug 10 05:17:26.450267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 149/288] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:26 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:26.484489 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-af9a982a-8f54-4b50-bfa7-006bf5e43771 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.674177 Aug 10 05:17:26.485129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 140/289] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:17:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:17:26.502405 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-901a45f3-011e-468e-925b-84e0f359fd79 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:26.503053 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-901a45f3-011e-468e-925b-84e0f359fd79 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:26.555198 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-901a45f3-011e-468e-925b-84e0f359fd79 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:26.562413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-901a45f3-011e-468e-925b-84e0f359fd79 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1213 microversion: 2.1 time: 0.064858 Aug 10 05:17:26.563768 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 150/290] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:26 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:26.668871 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cb9760cd-8e78-4566-9975-5c63b72998dc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:26.670019 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cb9760cd-8e78-4566-9975-5c63b72998dc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:26.677840 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb9760cd-8e78-4566-9975-5c63b72998dc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:26.678292 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb9760cd-8e78-4566-9975-5c63b72998dc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:26.679116 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb9760cd-8e78-4566-9975-5c63b72998dc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:26.679612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb9760cd-8e78-4566-9975-5c63b72998dc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:26.747886 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cb9760cd-8e78-4566-9975-5c63b72998dc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 32128 microversion: 2.20 time: 0.083834 Aug 10 05:17:26.752522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 141/291] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:26 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 32128 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:26.787547 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-634509ac-1603-4b18-96a3-7b66003664a4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:26.788634 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-634509ac-1603-4b18-96a3-7b66003664a4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:26.795154 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-634509ac-1603-4b18-96a3-7b66003664a4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:26.795826 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-634509ac-1603-4b18-96a3-7b66003664a4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:26.796853 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-634509ac-1603-4b18-96a3-7b66003664a4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:26.798015 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-634509ac-1603-4b18-96a3-7b66003664a4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:26.877143 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-634509ac-1603-4b18-96a3-7b66003664a4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 33672 microversion: 2.1 time: 0.093447 Aug 10 05:17:26.877790 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 151/292] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:26 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 33672 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:27.467940 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-804bfda5-a2d9-406b-882e-b0502ad80c71 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:27.468642 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-804bfda5-a2d9-406b-882e-b0502ad80c71 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:27.475596 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-804bfda5-a2d9-406b-882e-b0502ad80c71 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:27.476047 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-804bfda5-a2d9-406b-882e-b0502ad80c71 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:27.476828 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-804bfda5-a2d9-406b-882e-b0502ad80c71 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:27.477266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-804bfda5-a2d9-406b-882e-b0502ad80c71 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:27.580837 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b92ba183-44a5-4c8e-b815-db2507801568 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:27.581543 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b92ba183-44a5-4c8e-b815-db2507801568 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:27.588975 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b92ba183-44a5-4c8e-b815-db2507801568 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:27.589604 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b92ba183-44a5-4c8e-b815-db2507801568 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:27.592162 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b92ba183-44a5-4c8e-b815-db2507801568 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:27.592817 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b92ba183-44a5-4c8e-b815-db2507801568 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:27.621700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-804bfda5-a2d9-406b-882e-b0502ad80c71 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:27.630725 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-804bfda5-a2d9-406b-882e-b0502ad80c71 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.166925 Aug 10 05:17:27.631549 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 142/293] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:27 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:27.693351 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b92ba183-44a5-4c8e-b815-db2507801568 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:27.702485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b92ba183-44a5-4c8e-b815-db2507801568 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1217 microversion: 2.1 time: 0.126035 Aug 10 05:17:27.706491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 152/294] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:27 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1217 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:27.760332 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-90e74439-cfd0-4111-aa27-f36d5e12e16c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:27.761395 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-90e74439-cfd0-4111-aa27-f36d5e12e16c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:27.768010 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-90e74439-cfd0-4111-aa27-f36d5e12e16c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:27.768550 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-90e74439-cfd0-4111-aa27-f36d5e12e16c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:27.769427 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-90e74439-cfd0-4111-aa27-f36d5e12e16c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:27.769934 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-90e74439-cfd0-4111-aa27-f36d5e12e16c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:27.853853 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-90e74439-cfd0-4111-aa27-f36d5e12e16c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 33076 microversion: 2.20 time: 0.097589 Aug 10 05:17:27.856071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 143/295] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:27 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 33076 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:27.893403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-176dcb6e-e5ee-4f89-8eb5-714e7c2036ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:27.894374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-176dcb6e-e5ee-4f89-8eb5-714e7c2036ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:27.900761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-176dcb6e-e5ee-4f89-8eb5-714e7c2036ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:27.901345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-176dcb6e-e5ee-4f89-8eb5-714e7c2036ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:27.902096 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-176dcb6e-e5ee-4f89-8eb5-714e7c2036ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:27.902902 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-176dcb6e-e5ee-4f89-8eb5-714e7c2036ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:28.100282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-176dcb6e-e5ee-4f89-8eb5-714e7c2036ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 34028 microversion: 2.1 time: 0.211546 Aug 10 05:17:28.101634 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 153/296] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:27 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 34028 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:28.649742 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f1aeaf48-c998-412d-b9b7-8c8de64cf21a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:28.651019 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f1aeaf48-c998-412d-b9b7-8c8de64cf21a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:28.658666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f1aeaf48-c998-412d-b9b7-8c8de64cf21a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:28.659704 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f1aeaf48-c998-412d-b9b7-8c8de64cf21a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:28.661312 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f1aeaf48-c998-412d-b9b7-8c8de64cf21a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:28.662057 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f1aeaf48-c998-412d-b9b7-8c8de64cf21a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:28.723338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a42ff4bb-3a91-435a-abc5-9ec4dfc7d4e4 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:28.723338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a42ff4bb-3a91-435a-abc5-9ec4dfc7d4e4 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:28.731028 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a42ff4bb-3a91-435a-abc5-9ec4dfc7d4e4 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:28.735827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a42ff4bb-3a91-435a-abc5-9ec4dfc7d4e4 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:28.735827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a42ff4bb-3a91-435a-abc5-9ec4dfc7d4e4 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:28.735827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a42ff4bb-3a91-435a-abc5-9ec4dfc7d4e4 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:28.807621 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a42ff4bb-3a91-435a-abc5-9ec4dfc7d4e4 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:28.821657 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a42ff4bb-3a91-435a-abc5-9ec4dfc7d4e4 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1273 microversion: 2.1 time: 0.105263 Aug 10 05:17:28.823296 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 154/297] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:28 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:28.866257 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0fafe755-4d8b-492b-8f16-b3cdd4e69939 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:28.867373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0fafe755-4d8b-492b-8f16-b3cdd4e69939 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:28.873753 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0fafe755-4d8b-492b-8f16-b3cdd4e69939 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:28.874210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0fafe755-4d8b-492b-8f16-b3cdd4e69939 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:28.875024 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0fafe755-4d8b-492b-8f16-b3cdd4e69939 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:28.876338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0fafe755-4d8b-492b-8f16-b3cdd4e69939 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:28.953088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f1aeaf48-c998-412d-b9b7-8c8de64cf21a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:28.962514 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f1aeaf48-c998-412d-b9b7-8c8de64cf21a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.318122 Aug 10 05:17:28.963860 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 144/298] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:28 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:28.965912 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0fafe755-4d8b-492b-8f16-b3cdd4e69939 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 33652 microversion: 2.20 time: 0.103597 Aug 10 05:17:28.972793 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 155/299] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:28 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 33652 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:29.114468 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c371c83e-963a-43b9-ac5b-e5192eef2fc2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:29.117238 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c371c83e-963a-43b9-ac5b-e5192eef2fc2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:29.133756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c371c83e-963a-43b9-ac5b-e5192eef2fc2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:29.133756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c371c83e-963a-43b9-ac5b-e5192eef2fc2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:29.135944 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c371c83e-963a-43b9-ac5b-e5192eef2fc2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:29.136662 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c371c83e-963a-43b9-ac5b-e5192eef2fc2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:29.249113 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c371c83e-963a-43b9-ac5b-e5192eef2fc2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 34392 microversion: 2.1 time: 0.140367 Aug 10 05:17:29.251152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 145/300] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:29 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 34392 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:29.841357 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5ed97d5a-ab03-4192-8d59-b7eabfb1891b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:29.842462 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5ed97d5a-ab03-4192-8d59-b7eabfb1891b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:29.851715 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ed97d5a-ab03-4192-8d59-b7eabfb1891b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:29.852206 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ed97d5a-ab03-4192-8d59-b7eabfb1891b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:29.853053 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ed97d5a-ab03-4192-8d59-b7eabfb1891b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:29.853465 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ed97d5a-ab03-4192-8d59-b7eabfb1891b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:29.980182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-78a74d7e-035a-461f-ae71-943a1ee3a308 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:29.981183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-78a74d7e-035a-461f-ae71-943a1ee3a308 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:29.988354 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-78a74d7e-035a-461f-ae71-943a1ee3a308 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:29.988803 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-78a74d7e-035a-461f-ae71-943a1ee3a308 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:29.989904 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-78a74d7e-035a-461f-ae71-943a1ee3a308 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:29.990278 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-78a74d7e-035a-461f-ae71-943a1ee3a308 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:29.994114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5ed97d5a-ab03-4192-8d59-b7eabfb1891b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:30.002086 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5ed97d5a-ab03-4192-8d59-b7eabfb1891b tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1313 microversion: 2.1 time: 0.164963 Aug 10 05:17:30.002786 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 156/301] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:29 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:30.007465 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-195e9eb4-2799-4f82-bec1-2233d76bb88c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:30.008127 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-195e9eb4-2799-4f82-bec1-2233d76bb88c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:30.013819 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-195e9eb4-2799-4f82-bec1-2233d76bb88c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.014263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-195e9eb4-2799-4f82-bec1-2233d76bb88c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.015246 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-195e9eb4-2799-4f82-bec1-2233d76bb88c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.015747 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-195e9eb4-2799-4f82-bec1-2233d76bb88c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.070263 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-78a74d7e-035a-461f-ae71-943a1ee3a308 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 34221 microversion: 2.20 time: 0.094032 Aug 10 05:17:30.074627 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 146/302] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:29 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 34221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:30.150105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-195e9eb4-2799-4f82-bec1-2233d76bb88c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:30.165018 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-195e9eb4-2799-4f82-bec1-2233d76bb88c tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1502 microversion: 2.1 time: 0.160963 Aug 10 05:17:30.165718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 157/303] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:30 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:30.188722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "922f77d3-ed9a-4542-a244-1aa5a94d11dc"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:30.189859 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:30.196764 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.197175 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.198124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.198764 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.229731 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] HTTP exception thrown: Cannot 'attach_volume' instance 087a4339-30e4-48c7-aae6-024174e2d953 while it is in vm_state rescued Aug 10 05:17:30.230327 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Returning 409 to user: Cannot 'attach_volume' instance 087a4339-30e4-48c7-aae6-024174e2d953 while it is in vm_state rescued {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:17:30.231184 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-10190a3f-a1c0-479c-80ca-b78c09a2ecbc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046829 Aug 10 05:17:30.232276 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 147/304] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:17:30 2021] POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 05:17:30.242385 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-82396cc7-e64b-4d0f-bf79-ef25b53ca859 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:30.242870 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-82396cc7-e64b-4d0f-bf79-ef25b53ca859 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:30.249834 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-82396cc7-e64b-4d0f-bf79-ef25b53ca859 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.250982 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-82396cc7-e64b-4d0f-bf79-ef25b53ca859 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.262101 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-82396cc7-e64b-4d0f-bf79-ef25b53ca859 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.262101 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-82396cc7-e64b-4d0f-bf79-ef25b53ca859 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.262285 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-726a6984-f03e-4f0a-8283-1fd3ef8d88cb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:30.262592 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-726a6984-f03e-4f0a-8283-1fd3ef8d88cb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:30.269301 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-726a6984-f03e-4f0a-8283-1fd3ef8d88cb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.269762 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-726a6984-f03e-4f0a-8283-1fd3ef8d88cb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.270599 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-726a6984-f03e-4f0a-8283-1fd3ef8d88cb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.271190 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-726a6984-f03e-4f0a-8283-1fd3ef8d88cb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.352490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-726a6984-f03e-4f0a-8283-1fd3ef8d88cb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 35405 microversion: 2.1 time: 0.094838 Aug 10 05:17:30.353343 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 148/305] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:30 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 35405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:30.541403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-82396cc7-e64b-4d0f-bf79-ef25b53ca859 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/action" status: 202 len: 0 microversion: 2.1 time: 0.303031 Aug 10 05:17:30.542293 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 158/306] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:30 2021] POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:30.559818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f4ab9868-261e-4675-aed9-2834c2c209bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:30.560582 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f4ab9868-261e-4675-aed9-2834c2c209bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:30.568031 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f4ab9868-261e-4675-aed9-2834c2c209bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.568596 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f4ab9868-261e-4675-aed9-2834c2c209bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.569456 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f4ab9868-261e-4675-aed9-2834c2c209bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:30.569888 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f4ab9868-261e-4675-aed9-2834c2c209bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:30.689803 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f4ab9868-261e-4675-aed9-2834c2c209bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:30.697070 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f4ab9868-261e-4675-aed9-2834c2c209bd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1510 microversion: 2.1 time: 0.141341 Aug 10 05:17:30.701277 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 149/307] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:30 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1510 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:31.027618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-21392022-93ce-49a3-abdb-40c38a023952 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:31.029501 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-21392022-93ce-49a3-abdb-40c38a023952 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:31.037050 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-21392022-93ce-49a3-abdb-40c38a023952 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.037824 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-21392022-93ce-49a3-abdb-40c38a023952 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.038880 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-21392022-93ce-49a3-abdb-40c38a023952 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.039546 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-21392022-93ce-49a3-abdb-40c38a023952 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.077339 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-e3fabbd6-f8f8-4d6e-9a78-0782c5718af1 req-1de2d60d-2e55-4b2f-aece-49f7f682e56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53fb2afb-af91-47f4-8428-1de4374d55a8", "tag": "ee43fcfd-ae6a-49d2-8b5c-c4c92311f80e"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:31.080198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:17:31.080198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:17:31.089445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-e3fabbd6-f8f8-4d6e-9a78-0782c5718af1 req-1de2d60d-2e55-4b2f-aece-49f7f682e56f service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.090182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-e3fabbd6-f8f8-4d6e-9a78-0782c5718af1 req-1de2d60d-2e55-4b2f-aece-49f7f682e56f service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.103300 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-e3fabbd6-f8f8-4d6e-9a78-0782c5718af1 req-1de2d60d-2e55-4b2f-aece-49f7f682e56f service nova] Creating event network-changed:ee43fcfd-ae6a-49d2-8b5c-c4c92311f80e for instance 53fb2afb-af91-47f4-8428-1de4374d55a8 on hv-cinder-80390 Aug 10 05:17:31.113356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-e3fabbd6-f8f8-4d6e-9a78-0782c5718af1 req-1de2d60d-2e55-4b2f-aece-49f7f682e56f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038937 Aug 10 05:17:31.113356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 150/308] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:17:31.118059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6b21437e-ad17-4499-a1d0-d611eefac0ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:31.119345 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6b21437e-ad17-4499-a1d0-d611eefac0ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:31.126768 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b21437e-ad17-4499-a1d0-d611eefac0ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.127228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b21437e-ad17-4499-a1d0-d611eefac0ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.128002 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b21437e-ad17-4499-a1d0-d611eefac0ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.128436 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6b21437e-ad17-4499-a1d0-d611eefac0ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.279432 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-21392022-93ce-49a3-abdb-40c38a023952 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:31.286834 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-21392022-93ce-49a3-abdb-40c38a023952 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1313 microversion: 2.1 time: 0.265047 Aug 10 05:17:31.296411 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 159/309] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:31 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:31.341328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6b21437e-ad17-4499-a1d0-d611eefac0ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 34876 microversion: 2.20 time: 0.227097 Aug 10 05:17:31.342506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 151/310] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:31 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 34876 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:31.365471 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9d5181b5-b6fd-4b30-bfab-3ed50ebd2537 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:31.366444 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9d5181b5-b6fd-4b30-bfab-3ed50ebd2537 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:31.376303 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9d5181b5-b6fd-4b30-bfab-3ed50ebd2537 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.377006 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9d5181b5-b6fd-4b30-bfab-3ed50ebd2537 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.379613 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9d5181b5-b6fd-4b30-bfab-3ed50ebd2537 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.380392 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9d5181b5-b6fd-4b30-bfab-3ed50ebd2537 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.471019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9d5181b5-b6fd-4b30-bfab-3ed50ebd2537 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 36187 microversion: 2.1 time: 0.109420 Aug 10 05:17:31.475046 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 160/311] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:31 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 36187 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:31.763847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cd228bfd-f3fe-4f28-a2d2-22dbec0d22c8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:31.765917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cd228bfd-f3fe-4f28-a2d2-22dbec0d22c8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:31.770822 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cd228bfd-f3fe-4f28-a2d2-22dbec0d22c8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.771452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cd228bfd-f3fe-4f28-a2d2-22dbec0d22c8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.772377 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cd228bfd-f3fe-4f28-a2d2-22dbec0d22c8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:31.772750 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cd228bfd-f3fe-4f28-a2d2-22dbec0d22c8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:31.976952 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cd228bfd-f3fe-4f28-a2d2-22dbec0d22c8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:31.985023 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cd228bfd-f3fe-4f28-a2d2-22dbec0d22c8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1510 microversion: 2.1 time: 0.225237 Aug 10 05:17:31.985716 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 152/312] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:31 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1510 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:32.303448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aae81c29-9400-49bf-9648-5cdcdd0cc837 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:32.304242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-aae81c29-9400-49bf-9648-5cdcdd0cc837 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:32.311041 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aae81c29-9400-49bf-9648-5cdcdd0cc837 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:32.311489 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aae81c29-9400-49bf-9648-5cdcdd0cc837 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:32.312306 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aae81c29-9400-49bf-9648-5cdcdd0cc837 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:32.313236 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aae81c29-9400-49bf-9648-5cdcdd0cc837 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:32.352936 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9d9455f4-5c21-4732-b58a-47e2e7be5fd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:32.353875 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9d9455f4-5c21-4732-b58a-47e2e7be5fd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:32.359809 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d9455f4-5c21-4732-b58a-47e2e7be5fd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:32.363373 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d9455f4-5c21-4732-b58a-47e2e7be5fd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:32.363373 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d9455f4-5c21-4732-b58a-47e2e7be5fd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:32.363373 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d9455f4-5c21-4732-b58a-47e2e7be5fd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:32.436061 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aae81c29-9400-49bf-9648-5cdcdd0cc837 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:32.439294 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9d9455f4-5c21-4732-b58a-47e2e7be5fd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 35911 microversion: 2.20 time: 0.089793 Aug 10 05:17:32.439933 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 153/313] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:32 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 35911 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:32.444700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aae81c29-9400-49bf-9648-5cdcdd0cc837 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1313 microversion: 2.1 time: 0.145400 Aug 10 05:17:32.445248 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 161/314] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:32 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:32.482785 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-91c603b5-10ae-4c5f-b880-1df6b682d31f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:32.483767 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-91c603b5-10ae-4c5f-b880-1df6b682d31f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:32.490522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-91c603b5-10ae-4c5f-b880-1df6b682d31f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:32.490999 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-91c603b5-10ae-4c5f-b880-1df6b682d31f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:32.491761 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-91c603b5-10ae-4c5f-b880-1df6b682d31f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:32.492223 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-91c603b5-10ae-4c5f-b880-1df6b682d31f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:32.580463 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-91c603b5-10ae-4c5f-b880-1df6b682d31f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 37064 microversion: 2.1 time: 0.101373 Aug 10 05:17:32.581457 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 154/315] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:32 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 37064 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:33.003021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4df4e099-9d10-4a3f-82a3-3806fd26fc6d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:33.003721 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4df4e099-9d10-4a3f-82a3-3806fd26fc6d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:33.009425 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4df4e099-9d10-4a3f-82a3-3806fd26fc6d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.009886 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4df4e099-9d10-4a3f-82a3-3806fd26fc6d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.010683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4df4e099-9d10-4a3f-82a3-3806fd26fc6d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.011294 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4df4e099-9d10-4a3f-82a3-3806fd26fc6d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.106376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-675296896", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:33.146380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4df4e099-9d10-4a3f-82a3-3806fd26fc6d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:33.155287 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4df4e099-9d10-4a3f-82a3-3806fd26fc6d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1510 microversion: 2.1 time: 0.155872 Aug 10 05:17:33.155967 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 162/316] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:32 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:33.158113 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] validate_networks() for None {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:17:33.427825 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:17:33.428405 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:17:33.428700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:17:33.429105 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:17:33.429511 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:17:33.439678 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.440442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.440975 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.441418 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.450337 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-97e429af-f72f-4820-ae7d-ea682125eba9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:33.451219 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-97e429af-f72f-4820-ae7d-ea682125eba9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:33.458414 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Getting quotas for project 2ccf4a61cc694f948205f646df3c3622. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:17:33.459252 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97e429af-f72f-4820-ae7d-ea682125eba9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.459703 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97e429af-f72f-4820-ae7d-ea682125eba9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.460485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97e429af-f72f-4820-ae7d-ea682125eba9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.460923 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97e429af-f72f-4820-ae7d-ea682125eba9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.462512 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Getting quotas for user 0fd32fe141a547368b7c16df3156aa16 and project 2ccf4a61cc694f948205f646df3c3622. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:17:33.473585 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:17:33.476138 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:17:33.530114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-97e429af-f72f-4820-ae7d-ea682125eba9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 36538 microversion: 2.20 time: 0.083259 Aug 10 05:17:33.531571 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 163/317] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:33 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 36538 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:33.536103 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-89d653a5-0c5e-4171-b310-54b8807492ed tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:33.536811 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-89d653a5-0c5e-4171-b310-54b8807492ed tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:33.543127 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89d653a5-0c5e-4171-b310-54b8807492ed tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.543582 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89d653a5-0c5e-4171-b310-54b8807492ed tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.544392 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89d653a5-0c5e-4171-b310-54b8807492ed tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.544826 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89d653a5-0c5e-4171-b310-54b8807492ed tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.590417 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-43e6e2ba-65fb-4e60-a7de-96357c93f644 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.488014 Aug 10 05:17:33.591350 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 155/318] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:17:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 05:17:33.596112 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e5e0caf6-2e3b-4624-923f-0bf7428da1b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:33.597357 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e5e0caf6-2e3b-4624-923f-0bf7428da1b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:33.603547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e5e0caf6-2e3b-4624-923f-0bf7428da1b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.604027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e5e0caf6-2e3b-4624-923f-0bf7428da1b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.606489 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e5e0caf6-2e3b-4624-923f-0bf7428da1b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:33.607143 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e5e0caf6-2e3b-4624-923f-0bf7428da1b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:33.684735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-89d653a5-0c5e-4171-b310-54b8807492ed tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:33.685280 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e5e0caf6-2e3b-4624-923f-0bf7428da1b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 37699 microversion: 2.1 time: 0.092423 Aug 10 05:17:33.686756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 156/319] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:33 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 37699 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:33.693763 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-89d653a5-0c5e-4171-b310-54b8807492ed tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1313 microversion: 2.1 time: 0.161731 Aug 10 05:17:33.694037 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-24054eb3-505e-4980-9044-3430b02bb63f tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:33.694770 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 164/320] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:33 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:33.694962 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-24054eb3-505e-4980-9044-3430b02bb63f tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:33.752546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-24054eb3-505e-4980-9044-3430b02bb63f tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:33.758546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-24054eb3-505e-4980-9044-3430b02bb63f tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1214 microversion: 2.1 time: 0.069523 Aug 10 05:17:33.759362 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 157/321] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:33 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:34.172744 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9ca8e5b9-ff3b-47eb-aac0-a85880d4b6c2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:34.173461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9ca8e5b9-ff3b-47eb-aac0-a85880d4b6c2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:34.179527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9ca8e5b9-ff3b-47eb-aac0-a85880d4b6c2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.180002 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9ca8e5b9-ff3b-47eb-aac0-a85880d4b6c2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.180766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9ca8e5b9-ff3b-47eb-aac0-a85880d4b6c2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.181198 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9ca8e5b9-ff3b-47eb-aac0-a85880d4b6c2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.300754 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9ca8e5b9-ff3b-47eb-aac0-a85880d4b6c2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:34.308075 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9ca8e5b9-ff3b-47eb-aac0-a85880d4b6c2 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1516 microversion: 2.1 time: 0.139548 Aug 10 05:17:34.308638 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 165/322] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:34 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1516 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:34.542493 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-45d21301-9c00-4dfb-b8f9-d8a080e4e2cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:34.544119 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-45d21301-9c00-4dfb-b8f9-d8a080e4e2cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:34.551629 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-45d21301-9c00-4dfb-b8f9-d8a080e4e2cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.552084 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-45d21301-9c00-4dfb-b8f9-d8a080e4e2cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.552857 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-45d21301-9c00-4dfb-b8f9-d8a080e4e2cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.553294 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-45d21301-9c00-4dfb-b8f9-d8a080e4e2cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.623252 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-45d21301-9c00-4dfb-b8f9-d8a080e4e2cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 37672 microversion: 2.20 time: 0.084542 Aug 10 05:17:34.627402 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 158/323] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:34 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 37672 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:34.697541 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c921c929-6aa1-4b56-a52a-386e17ed5611 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:34.698598 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c921c929-6aa1-4b56-a52a-386e17ed5611 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:34.705157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c921c929-6aa1-4b56-a52a-386e17ed5611 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.705611 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c921c929-6aa1-4b56-a52a-386e17ed5611 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.706403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c921c929-6aa1-4b56-a52a-386e17ed5611 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.706892 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c921c929-6aa1-4b56-a52a-386e17ed5611 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.711854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d7663065-6d20-4e0c-b788-a915cb795518 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:34.712867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d7663065-6d20-4e0c-b788-a915cb795518 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:34.720175 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d7663065-6d20-4e0c-b788-a915cb795518 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.720701 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d7663065-6d20-4e0c-b788-a915cb795518 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.721811 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d7663065-6d20-4e0c-b788-a915cb795518 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.722452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d7663065-6d20-4e0c-b788-a915cb795518 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.777966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c921c929-6aa1-4b56-a52a-386e17ed5611 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 38729 microversion: 2.1 time: 0.083927 Aug 10 05:17:34.779170 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 166/324] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:34 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 38729 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:34.784851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-12ea0560-abea-42af-a803-b370ffbdf7d3 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:34.791848 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-12ea0560-abea-42af-a803-b370ffbdf7d3 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:34.792608 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12ea0560-abea-42af-a803-b370ffbdf7d3 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.793063 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12ea0560-abea-42af-a803-b370ffbdf7d3 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.793839 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12ea0560-abea-42af-a803-b370ffbdf7d3 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:34.794451 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12ea0560-abea-42af-a803-b370ffbdf7d3 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:34.864213 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d7663065-6d20-4e0c-b788-a915cb795518 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:34.865926 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-12ea0560-abea-42af-a803-b370ffbdf7d3 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:34.872930 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d7663065-6d20-4e0c-b788-a915cb795518 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1313 microversion: 2.1 time: 0.165265 Aug 10 05:17:34.873564 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-12ea0560-abea-42af-a803-b370ffbdf7d3 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1218 microversion: 2.1 time: 0.093018 Aug 10 05:17:34.873927 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 159/325] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:34 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:34.874739 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 167/326] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:34 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:35.634379 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d539c0e0-1202-4597-bf3d-e28e19826a6a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:35.635954 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d539c0e0-1202-4597-bf3d-e28e19826a6a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:35.641710 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d539c0e0-1202-4597-bf3d-e28e19826a6a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:35.642160 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d539c0e0-1202-4597-bf3d-e28e19826a6a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:35.642971 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d539c0e0-1202-4597-bf3d-e28e19826a6a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:35.643567 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d539c0e0-1202-4597-bf3d-e28e19826a6a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:35.712071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d539c0e0-1202-4597-bf3d-e28e19826a6a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 38153 microversion: 2.20 time: 0.081029 Aug 10 05:17:35.716348 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 160/327] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:35 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 38153 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:35.790877 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-eee0253a-156b-44fb-a06d-62f8bef0a467 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:35.791896 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-eee0253a-156b-44fb-a06d-62f8bef0a467 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:35.802261 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eee0253a-156b-44fb-a06d-62f8bef0a467 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:35.803497 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eee0253a-156b-44fb-a06d-62f8bef0a467 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:35.803497 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eee0253a-156b-44fb-a06d-62f8bef0a467 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:35.803922 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eee0253a-156b-44fb-a06d-62f8bef0a467 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:35.884351 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-eee0253a-156b-44fb-a06d-62f8bef0a467 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 38803 microversion: 2.1 time: 0.097260 Aug 10 05:17:35.886059 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 168/328] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:35 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 38803 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:35.892502 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-641359fc-b606-41c7-83d6-6cce853caf21 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:35.892729 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2988b5ba-5f0c-411a-bbe3-76fafe47db49 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:35.893294 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-641359fc-b606-41c7-83d6-6cce853caf21 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:35.893425 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2988b5ba-5f0c-411a-bbe3-76fafe47db49 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:35.899792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2988b5ba-5f0c-411a-bbe3-76fafe47db49 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:35.900052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-641359fc-b606-41c7-83d6-6cce853caf21 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:35.903491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2988b5ba-5f0c-411a-bbe3-76fafe47db49 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:35.903603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-641359fc-b606-41c7-83d6-6cce853caf21 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:35.903681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2988b5ba-5f0c-411a-bbe3-76fafe47db49 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:35.903763 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-641359fc-b606-41c7-83d6-6cce853caf21 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:35.903836 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2988b5ba-5f0c-411a-bbe3-76fafe47db49 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:35.903906 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-641359fc-b606-41c7-83d6-6cce853caf21 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:35.972499 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2988b5ba-5f0c-411a-bbe3-76fafe47db49 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:35.981495 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2988b5ba-5f0c-411a-bbe3-76fafe47db49 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1274 microversion: 2.1 time: 0.094119 Aug 10 05:17:35.982384 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 169/329] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:35 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:36.024213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7ceff2a6-4234-4895-a9b6-f602a66a4c00 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:36.024707 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7ceff2a6-4234-4895-a9b6-f602a66a4c00 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:36.032037 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ceff2a6-4234-4895-a9b6-f602a66a4c00 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:36.032550 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ceff2a6-4234-4895-a9b6-f602a66a4c00 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:36.033524 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ceff2a6-4234-4895-a9b6-f602a66a4c00 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:36.034108 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ceff2a6-4234-4895-a9b6-f602a66a4c00 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:36.131647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-641359fc-b606-41c7-83d6-6cce853caf21 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:36.139018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-641359fc-b606-41c7-83d6-6cce853caf21 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1313 microversion: 2.1 time: 0.251967 Aug 10 05:17:36.139785 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 161/330] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:35 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:36.182856 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7ceff2a6-4234-4895-a9b6-f602a66a4c00 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:36.190813 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7ceff2a6-4234-4895-a9b6-f602a66a4c00 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1516 microversion: 2.1 time: 0.171091 Aug 10 05:17:36.191375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 170/331] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:36 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:36.207521 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bd70a233-8590-4a24-a20d-1cf9175edb2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "550ef900-c44d-4636-bbf6-a09fd56fb156"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:36.208567 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bd70a233-8590-4a24-a20d-1cf9175edb2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:36.214500 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bd70a233-8590-4a24-a20d-1cf9175edb2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:36.214987 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bd70a233-8590-4a24-a20d-1cf9175edb2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:36.215745 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bd70a233-8590-4a24-a20d-1cf9175edb2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:36.216179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bd70a233-8590-4a24-a20d-1cf9175edb2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:36.724366 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6f7c32f9-93ba-4c03-a354-db60bca980a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:36.725650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6f7c32f9-93ba-4c03-a354-db60bca980a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:36.731902 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f7c32f9-93ba-4c03-a354-db60bca980a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:36.732681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f7c32f9-93ba-4c03-a354-db60bca980a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:36.733676 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f7c32f9-93ba-4c03-a354-db60bca980a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:36.734322 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f7c32f9-93ba-4c03-a354-db60bca980a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:36.807623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6f7c32f9-93ba-4c03-a354-db60bca980a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 38153 microversion: 2.20 time: 0.086673 Aug 10 05:17:36.808842 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 171/332] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:36 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 38153 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:36.899647 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d3598f08-57a9-4f35-8354-b5a7cee2a045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:36.900637 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d3598f08-57a9-4f35-8354-b5a7cee2a045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:36.907278 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d3598f08-57a9-4f35-8354-b5a7cee2a045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:36.907724 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d3598f08-57a9-4f35-8354-b5a7cee2a045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:36.908527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d3598f08-57a9-4f35-8354-b5a7cee2a045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:36.908918 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d3598f08-57a9-4f35-8354-b5a7cee2a045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:36.981777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d3598f08-57a9-4f35-8354-b5a7cee2a045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 38824 microversion: 2.1 time: 0.086001 Aug 10 05:17:36.983432 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 172/333] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:36 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 38824 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:36.999579 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1db5692b-19e0-4a5b-977c-f173d90bfc41 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:37.004469 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1db5692b-19e0-4a5b-977c-f173d90bfc41 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:37.008854 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1db5692b-19e0-4a5b-977c-f173d90bfc41 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:37.009373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1db5692b-19e0-4a5b-977c-f173d90bfc41 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:37.010217 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1db5692b-19e0-4a5b-977c-f173d90bfc41 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:37.011074 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1db5692b-19e0-4a5b-977c-f173d90bfc41 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:37.071190 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bd70a233-8590-4a24-a20d-1cf9175edb2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867772 Aug 10 05:17:37.077926 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 162/334] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:17:36 2021] POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:17:37.104702 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-b69b8f9b-5e4f-4668-bd14-0fcaee287987 req-ad8d996a-99a7-46d1-bce7-9fe434b2ac63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fb2afb-af91-47f4-8428-1de4374d55a8", "name": "network-vif-plugged", "status": "completed", "tag": "ee43fcfd-ae6a-49d2-8b5c-c4c92311f80e"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:37.106344 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:17:37.106344 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:17:37.122191 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-b69b8f9b-5e4f-4668-bd14-0fcaee287987 req-ad8d996a-99a7-46d1-bce7-9fe434b2ac63 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:37.122676 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-b69b8f9b-5e4f-4668-bd14-0fcaee287987 req-ad8d996a-99a7-46d1-bce7-9fe434b2ac63 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:37.148062 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-b69b8f9b-5e4f-4668-bd14-0fcaee287987 req-ad8d996a-99a7-46d1-bce7-9fe434b2ac63 service nova] Creating event network-vif-plugged:ee43fcfd-ae6a-49d2-8b5c-c4c92311f80e for instance 53fb2afb-af91-47f4-8428-1de4374d55a8 on hv-cinder-80390 Aug 10 05:17:37.173053 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-b69b8f9b-5e4f-4668-bd14-0fcaee287987 req-ad8d996a-99a7-46d1-bce7-9fe434b2ac63 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071221 Aug 10 05:17:37.173857 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 163/335] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:17:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:17:37.181889 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2ba2b7d6-dfd5-4df1-a710-8400afae6f0c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:37.183030 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2ba2b7d6-dfd5-4df1-a710-8400afae6f0c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:37.200225 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ba2b7d6-dfd5-4df1-a710-8400afae6f0c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:37.200758 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ba2b7d6-dfd5-4df1-a710-8400afae6f0c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:37.201587 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ba2b7d6-dfd5-4df1-a710-8400afae6f0c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:37.202029 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ba2b7d6-dfd5-4df1-a710-8400afae6f0c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:37.295925 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1db5692b-19e0-4a5b-977c-f173d90bfc41 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:37.306380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1db5692b-19e0-4a5b-977c-f173d90bfc41 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.310897 Aug 10 05:17:37.307486 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 173/336] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:36 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:37.445311 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2ba2b7d6-dfd5-4df1-a710-8400afae6f0c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:37.454101 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2ba2b7d6-dfd5-4df1-a710-8400afae6f0c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1313 microversion: 2.1 time: 0.277332 Aug 10 05:17:37.455998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 164/337] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:37 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:37.820580 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c1e9f088-815b-46ae-b01b-a90ed76713b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:37.822173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c1e9f088-815b-46ae-b01b-a90ed76713b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:37.836331 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c1e9f088-815b-46ae-b01b-a90ed76713b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:37.836879 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c1e9f088-815b-46ae-b01b-a90ed76713b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:37.837779 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c1e9f088-815b-46ae-b01b-a90ed76713b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:37.838559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c1e9f088-815b-46ae-b01b-a90ed76713b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:37.915195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c1e9f088-815b-46ae-b01b-a90ed76713b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 38153 microversion: 2.20 time: 0.099170 Aug 10 05:17:37.916718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 174/338] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:37 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 38153 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:17:37.993611 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-951c5c6e-ef65-4181-ba10-55150d994a2b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:37.994647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-951c5c6e-ef65-4181-ba10-55150d994a2b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:38.001092 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-951c5c6e-ef65-4181-ba10-55150d994a2b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.001626 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-951c5c6e-ef65-4181-ba10-55150d994a2b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.002476 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-951c5c6e-ef65-4181-ba10-55150d994a2b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.002999 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-951c5c6e-ef65-4181-ba10-55150d994a2b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.079182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-951c5c6e-ef65-4181-ba10-55150d994a2b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 200 len: 38932 microversion: 2.1 time: 0.089492 Aug 10 05:17:38.079904 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 165/339] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:37 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 38932 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:17:38.090173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-dc42fb4a-e876-4a17-b0cb-e23c3d751f1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:38.090788 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-dc42fb4a-e876-4a17-b0cb-e23c3d751f1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:38.097225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dc42fb4a-e876-4a17-b0cb-e23c3d751f1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.097846 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dc42fb4a-e876-4a17-b0cb-e23c3d751f1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.098935 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dc42fb4a-e876-4a17-b0cb-e23c3d751f1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.099374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dc42fb4a-e876-4a17-b0cb-e23c3d751f1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.132513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-dc42fb4a-e876-4a17-b0cb-e23c3d751f1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/ips" status: 200 len: 145 microversion: 2.1 time: 0.046331 Aug 10 05:17:38.133431 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 175/340] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Aug 10 05:17:38 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/ips => generated 145 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:17:38.178480 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-94e59d58-2325-46f7-b5bd-0efb07a6e607 req-a6c0f2d9-51ea-487e-a903-16513d6c8b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55bd85f0-984b-44c8-8b35-45c2318ce955", "tag": "2e83aff6-4074-4b4c-840d-ddaba016bdab"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:38.181129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:17:38.181129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:17:38.189960 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-94e59d58-2325-46f7-b5bd-0efb07a6e607 req-a6c0f2d9-51ea-487e-a903-16513d6c8b74 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.190407 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-94e59d58-2325-46f7-b5bd-0efb07a6e607 req-a6c0f2d9-51ea-487e-a903-16513d6c8b74 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.203711 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-94e59d58-2325-46f7-b5bd-0efb07a6e607 req-a6c0f2d9-51ea-487e-a903-16513d6c8b74 service nova] Creating event network-changed:2e83aff6-4074-4b4c-840d-ddaba016bdab for instance 55bd85f0-984b-44c8-8b35-45c2318ce955 on hv-cinder-80390 Aug 10 05:17:38.208755 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-94e59d58-2325-46f7-b5bd-0efb07a6e607 req-a6c0f2d9-51ea-487e-a903-16513d6c8b74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038466 Aug 10 05:17:38.209791 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 166/341] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:17:38.331644 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9218642b-5d92-4c7d-93b1-55f4f6a90832 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:38.332185 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9218642b-5d92-4c7d-93b1-55f4f6a90832 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:38.339356 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9218642b-5d92-4c7d-93b1-55f4f6a90832 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.344600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9218642b-5d92-4c7d-93b1-55f4f6a90832 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.344600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9218642b-5d92-4c7d-93b1-55f4f6a90832 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.344600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9218642b-5d92-4c7d-93b1-55f4f6a90832 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.477361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a45e091f-546a-40ed-af50-4aee6d989afe tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:38.478533 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a45e091f-546a-40ed-af50-4aee6d989afe tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:38.491790 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9218642b-5d92-4c7d-93b1-55f4f6a90832 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:38.496049 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a45e091f-546a-40ed-af50-4aee6d989afe tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.496662 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a45e091f-546a-40ed-af50-4aee6d989afe tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.499537 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9218642b-5d92-4c7d-93b1-55f4f6a90832 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.171717 Aug 10 05:17:38.499809 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a45e091f-546a-40ed-af50-4aee6d989afe tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.500171 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 176/342] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:38 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:38.501041 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a45e091f-546a-40ed-af50-4aee6d989afe tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.927534 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-059c0d53-0bc4-4d8a-a431-3b316617ba3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:38.928457 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-059c0d53-0bc4-4d8a-a431-3b316617ba3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:38.934794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-059c0d53-0bc4-4d8a-a431-3b316617ba3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.935256 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-059c0d53-0bc4-4d8a-a431-3b316617ba3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.936040 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-059c0d53-0bc4-4d8a-a431-3b316617ba3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:38.936476 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-059c0d53-0bc4-4d8a-a431-3b316617ba3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:38.945024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a45e091f-546a-40ed-af50-4aee6d989afe tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:38.952990 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a45e091f-546a-40ed-af50-4aee6d989afe tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1313 microversion: 2.1 time: 0.484344 Aug 10 05:17:38.954085 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 167/343] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:38 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:39.008683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-059c0d53-0bc4-4d8a-a431-3b316617ba3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 38153 microversion: 2.20 time: 0.084858 Aug 10 05:17:39.009710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 177/344] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:38 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 38153 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:39.531969 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ea0d1737-657e-450e-a34a-94d823eaa7ff tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:39.532580 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ea0d1737-657e-450e-a34a-94d823eaa7ff tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:39.539849 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea0d1737-657e-450e-a34a-94d823eaa7ff tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:39.540296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea0d1737-657e-450e-a34a-94d823eaa7ff tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:39.541055 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea0d1737-657e-450e-a34a-94d823eaa7ff tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:39.541487 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ea0d1737-657e-450e-a34a-94d823eaa7ff tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:39.659356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ea0d1737-657e-450e-a34a-94d823eaa7ff tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:39.667292 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ea0d1737-657e-450e-a34a-94d823eaa7ff tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.140467 Aug 10 05:17:39.667867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 168/345] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:39 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:39.969960 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9a6495eb-1a65-4868-b11f-5cffb78872b7 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:39.970689 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9a6495eb-1a65-4868-b11f-5cffb78872b7 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:39.977190 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9a6495eb-1a65-4868-b11f-5cffb78872b7 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:39.977641 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9a6495eb-1a65-4868-b11f-5cffb78872b7 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:39.978417 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9a6495eb-1a65-4868-b11f-5cffb78872b7 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:39.978880 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9a6495eb-1a65-4868-b11f-5cffb78872b7 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.021035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-63c9872f-bbd4-4c95-b984-74463bd15f66 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:40.021917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-63c9872f-bbd4-4c95-b984-74463bd15f66 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:40.027647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-63c9872f-bbd4-4c95-b984-74463bd15f66 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:40.028098 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-63c9872f-bbd4-4c95-b984-74463bd15f66 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.028869 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-63c9872f-bbd4-4c95-b984-74463bd15f66 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:40.029302 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-63c9872f-bbd4-4c95-b984-74463bd15f66 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.097903 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9a6495eb-1a65-4868-b11f-5cffb78872b7 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:40.103646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-63c9872f-bbd4-4c95-b984-74463bd15f66 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 200 len: 38296 microversion: 2.20 time: 0.086283 Aug 10 05:17:40.104289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 169/346] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:40 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 38296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:40.105184 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9a6495eb-1a65-4868-b11f-5cffb78872b7 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1497 microversion: 2.1 time: 0.139194 Aug 10 05:17:40.105736 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 178/347] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:39 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:40.114594 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bc552437-0af8-4374-ba47-d24e421d1796 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:40.115425 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bc552437-0af8-4374-ba47-d24e421d1796 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:40.122147 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bc552437-0af8-4374-ba47-d24e421d1796 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:40.122622 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bc552437-0af8-4374-ba47-d24e421d1796 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.123401 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bc552437-0af8-4374-ba47-d24e421d1796 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:40.123842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bc552437-0af8-4374-ba47-d24e421d1796 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.148983 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bc552437-0af8-4374-ba47-d24e421d1796 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/ips" status: 200 len: 153 microversion: 2.20 time: 0.038083 Aug 10 05:17:40.149577 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 170/348] 10.222.0.16 () {60 vars in 1289 bytes} [Tue Aug 10 05:17:40 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:17:40.686544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d1b5d55c-137a-4d12-9d71-8dabdcd3b4cc tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:40.689784 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d1b5d55c-137a-4d12-9d71-8dabdcd3b4cc tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:40.710381 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d1b5d55c-137a-4d12-9d71-8dabdcd3b4cc tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:40.715528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d1b5d55c-137a-4d12-9d71-8dabdcd3b4cc tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.718472 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d1b5d55c-137a-4d12-9d71-8dabdcd3b4cc tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:40.718472 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d1b5d55c-137a-4d12-9d71-8dabdcd3b4cc tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.833203 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c6564283-8cfe-4fbb-93ad-1316ad14d882 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6883fb8c-f59c-41c2-b1b4-bd1a11c9c4b4"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:40.835018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c6564283-8cfe-4fbb-93ad-1316ad14d882 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:40.841677 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c6564283-8cfe-4fbb-93ad-1316ad14d882 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:40.842180 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c6564283-8cfe-4fbb-93ad-1316ad14d882 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.842996 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c6564283-8cfe-4fbb-93ad-1316ad14d882 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:40.844832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c6564283-8cfe-4fbb-93ad-1316ad14d882 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:40.858841 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d1b5d55c-137a-4d12-9d71-8dabdcd3b4cc tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:40.867529 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d1b5d55c-137a-4d12-9d71-8dabdcd3b4cc tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.186992 Aug 10 05:17:40.869766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 179/349] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:40 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:41.316442 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-495b1e82-330d-44f0-807d-7c1bbfdfce90 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:41.317062 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-495b1e82-330d-44f0-807d-7c1bbfdfce90 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:41.323390 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-495b1e82-330d-44f0-807d-7c1bbfdfce90 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:41.323845 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-495b1e82-330d-44f0-807d-7c1bbfdfce90 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:41.324627 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-495b1e82-330d-44f0-807d-7c1bbfdfce90 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:41.325064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-495b1e82-330d-44f0-807d-7c1bbfdfce90 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:41.349969 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-495b1e82-330d-44f0-807d-7c1bbfdfce90 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:17:41.690343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-495b1e82-330d-44f0-807d-7c1bbfdfce90 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "DELETE /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 204 len: 0 microversion: 2.1 time: 0.377871 Aug 10 05:17:41.691050 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 180/350] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:17:41 2021] DELETE /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 05:17:41.699864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ef8d01a1-f739-4052-b178-a0f1ab61fbf1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:41.700054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ef8d01a1-f739-4052-b178-a0f1ab61fbf1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:41.706162 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ef8d01a1-f739-4052-b178-a0f1ab61fbf1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:41.706634 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ef8d01a1-f739-4052-b178-a0f1ab61fbf1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:41.707397 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ef8d01a1-f739-4052-b178-a0f1ab61fbf1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:41.707821 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ef8d01a1-f739-4052-b178-a0f1ab61fbf1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:41.829681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ef8d01a1-f739-4052-b178-a0f1ab61fbf1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:41.837114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ef8d01a1-f739-4052-b178-a0f1ab61fbf1 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1503 microversion: 2.1 time: 0.141536 Aug 10 05:17:41.837677 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 181/351] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:41 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1503 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:41.888681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-15abc034-d813-4c3e-85c2-3c5953f1c803 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:41.889399 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-15abc034-d813-4c3e-85c2-3c5953f1c803 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:41.895196 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15abc034-d813-4c3e-85c2-3c5953f1c803 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:41.895645 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15abc034-d813-4c3e-85c2-3c5953f1c803 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:41.902503 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15abc034-d813-4c3e-85c2-3c5953f1c803 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:41.902503 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15abc034-d813-4c3e-85c2-3c5953f1c803 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:41.950181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c6564283-8cfe-4fbb-93ad-1316ad14d882 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.121538 Aug 10 05:17:41.950981 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 171/352] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:17:40 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/os-volume_attachments => generated 194 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:17:42.017378 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-15abc034-d813-4c3e-85c2-3c5953f1c803 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:42.024666 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-15abc034-d813-4c3e-85c2-3c5953f1c803 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.139388 Aug 10 05:17:42.025393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 182/353] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:41 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:42.855396 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b1448b40-060c-4c05-b40b-f138e544ad4c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:42.856088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b1448b40-060c-4c05-b40b-f138e544ad4c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:42.863023 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b1448b40-060c-4c05-b40b-f138e544ad4c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:42.863471 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b1448b40-060c-4c05-b40b-f138e544ad4c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:42.864226 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b1448b40-060c-4c05-b40b-f138e544ad4c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:42.864656 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b1448b40-060c-4c05-b40b-f138e544ad4c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:42.980943 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b1448b40-060c-4c05-b40b-f138e544ad4c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:42.988710 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b1448b40-060c-4c05-b40b-f138e544ad4c tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1503 microversion: 2.1 time: 0.137846 Aug 10 05:17:42.989270 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 172/354] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:42 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1503 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:43.040845 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b40a2598-25cb-4049-98ef-2c7189908e03 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:43.041460 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b40a2598-25cb-4049-98ef-2c7189908e03 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:43.047719 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b40a2598-25cb-4049-98ef-2c7189908e03 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:43.048171 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b40a2598-25cb-4049-98ef-2c7189908e03 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:43.048937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b40a2598-25cb-4049-98ef-2c7189908e03 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:43.049371 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b40a2598-25cb-4049-98ef-2c7189908e03 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:43.169263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b40a2598-25cb-4049-98ef-2c7189908e03 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:43.176544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b40a2598-25cb-4049-98ef-2c7189908e03 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.139336 Aug 10 05:17:43.177106 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 183/355] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:43 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:44.006032 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-66285a5b-a1a2-44e6-a2f2-a35f4e6ed7f9 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:44.006673 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-66285a5b-a1a2-44e6-a2f2-a35f4e6ed7f9 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:44.012544 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-66285a5b-a1a2-44e6-a2f2-a35f4e6ed7f9 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:44.012995 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-66285a5b-a1a2-44e6-a2f2-a35f4e6ed7f9 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:44.013760 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-66285a5b-a1a2-44e6-a2f2-a35f4e6ed7f9 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:44.014194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-66285a5b-a1a2-44e6-a2f2-a35f4e6ed7f9 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:44.134233 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-66285a5b-a1a2-44e6-a2f2-a35f4e6ed7f9 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:44.141315 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-66285a5b-a1a2-44e6-a2f2-a35f4e6ed7f9 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1503 microversion: 2.1 time: 0.138941 Aug 10 05:17:44.141862 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 173/356] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:44 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1503 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:44.193420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ae994f02-c979-43ee-8ffb-e45dda4b053d tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:44.194035 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ae994f02-c979-43ee-8ffb-e45dda4b053d tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:44.200305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae994f02-c979-43ee-8ffb-e45dda4b053d tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:44.200763 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae994f02-c979-43ee-8ffb-e45dda4b053d tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:44.201536 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae994f02-c979-43ee-8ffb-e45dda4b053d tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:44.201976 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae994f02-c979-43ee-8ffb-e45dda4b053d tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:44.327670 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ae994f02-c979-43ee-8ffb-e45dda4b053d tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:44.334847 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ae994f02-c979-43ee-8ffb-e45dda4b053d tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.145000 Aug 10 05:17:44.335395 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 184/357] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:44 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:44.891629 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9c8267bf-c846-4c1b-a386-751a170e4ad7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:44.892166 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9c8267bf-c846-4c1b-a386-751a170e4ad7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:44.898354 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9c8267bf-c846-4c1b-a386-751a170e4ad7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:44.898848 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9c8267bf-c846-4c1b-a386-751a170e4ad7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:44.899624 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9c8267bf-c846-4c1b-a386-751a170e4ad7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:44.900077 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9c8267bf-c846-4c1b-a386-751a170e4ad7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:44.922692 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-9c8267bf-c846-4c1b-a386-751a170e4ad7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lazy-loading 'flavor' on Instance uuid 125a0f58-1cac-47b7-8486-e02530bcfb8f {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:17:45.158008 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-94dd33b6-4870-42ad-91df-2c1fda564411 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:45.158654 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-94dd33b6-4870-42ad-91df-2c1fda564411 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:45.164530 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94dd33b6-4870-42ad-91df-2c1fda564411 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:45.164992 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94dd33b6-4870-42ad-91df-2c1fda564411 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:45.165762 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94dd33b6-4870-42ad-91df-2c1fda564411 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:45.166193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94dd33b6-4870-42ad-91df-2c1fda564411 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:45.290267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-94dd33b6-4870-42ad-91df-2c1fda564411 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:45.297599 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-94dd33b6-4870-42ad-91df-2c1fda564411 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1503 microversion: 2.1 time: 0.143348 Aug 10 05:17:45.298152 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 185/358] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:45 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1503 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:45.353452 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-240b0aaf-b8f4-41c3-946b-2b5d0dcbbf44 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:45.353900 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-240b0aaf-b8f4-41c3-946b-2b5d0dcbbf44 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:45.371868 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-240b0aaf-b8f4-41c3-946b-2b5d0dcbbf44 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:45.372327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-240b0aaf-b8f4-41c3-946b-2b5d0dcbbf44 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:45.373116 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-240b0aaf-b8f4-41c3-946b-2b5d0dcbbf44 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:45.373621 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-240b0aaf-b8f4-41c3-946b-2b5d0dcbbf44 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:45.500853 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9c8267bf-c846-4c1b-a386-751a170e4ad7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 202 len: 0 microversion: 2.20 time: 0.612576 Aug 10 05:17:45.502194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 174/359] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:17:44 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 05:17:45.510843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:45.511548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:45.519658 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:45.520260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:45.521017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:45.521512 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:45.642114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-240b0aaf-b8f4-41c3-946b-2b5d0dcbbf44 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:45.654019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-240b0aaf-b8f4-41c3-946b-2b5d0dcbbf44 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.304825 Aug 10 05:17:45.654888 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 186/360] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:45 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:45.659626 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:45.667565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:45.669043 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:45.674683 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1683f2a3-4ec1-4327-8042-3cae7d046384 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.163472 Aug 10 05:17:45.674683 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 175/361] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:45 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:17:46.314882 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ae9a3be0-3816-4bb4-bf6b-e1a2f1695bde tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:46.315539 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ae9a3be0-3816-4bb4-bf6b-e1a2f1695bde tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:46.321294 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae9a3be0-3816-4bb4-bf6b-e1a2f1695bde tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:46.321744 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae9a3be0-3816-4bb4-bf6b-e1a2f1695bde tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:46.322511 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae9a3be0-3816-4bb4-bf6b-e1a2f1695bde tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:46.322976 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae9a3be0-3816-4bb4-bf6b-e1a2f1695bde tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:46.447649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ae9a3be0-3816-4bb4-bf6b-e1a2f1695bde tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:46.458684 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ae9a3be0-3816-4bb4-bf6b-e1a2f1695bde tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1503 microversion: 2.1 time: 0.144122 Aug 10 05:17:46.458684 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 187/362] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:46 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1503 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:46.671421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e3530183-3043-4f2c-924c-a68995ceed08 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:46.672066 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e3530183-3043-4f2c-924c-a68995ceed08 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:46.678543 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e3530183-3043-4f2c-924c-a68995ceed08 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:46.679229 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e3530183-3043-4f2c-924c-a68995ceed08 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:46.680015 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e3530183-3043-4f2c-924c-a68995ceed08 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:46.680455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e3530183-3043-4f2c-924c-a68995ceed08 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:46.691162 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:46.692164 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:46.698755 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:46.699200 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:46.699970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:46.700397 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:46.827735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:46.836656 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:46.839710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:46.839710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-03f6182b-f06e-4501-85e7-45dedea5eaac tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.152020 Aug 10 05:17:46.840267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 188/363] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:46 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:46.883561 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e3530183-3043-4f2c-924c-a68995ceed08 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:46.891526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e3530183-3043-4f2c-924c-a68995ceed08 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.223316 Aug 10 05:17:46.892306 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 176/364] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:46 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:47.063412 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b3e817f6-d144-4f86-8cb4-de5df890c544 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:47.064673 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b3e817f6-d144-4f86-8cb4-de5df890c544 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:47.071338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b3e817f6-d144-4f86-8cb4-de5df890c544 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.071989 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b3e817f6-d144-4f86-8cb4-de5df890c544 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.072919 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b3e817f6-d144-4f86-8cb4-de5df890c544 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.073555 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b3e817f6-d144-4f86-8cb4-de5df890c544 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.103261 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-b3e817f6-d144-4f86-8cb4-de5df890c544 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lazy-loading 'flavor' on Instance uuid 087a4339-30e4-48c7-aae6-024174e2d953 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:17:47.155777 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-8b401959-b40f-457e-85a3-89364d1f0d06 req-a1e77054-a32c-45e6-a7e9-499a029ff712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fb2afb-af91-47f4-8428-1de4374d55a8", "name": "network-vif-deleted", "tag": "ee43fcfd-ae6a-49d2-8b5c-c4c92311f80e"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:47.158729 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:17:47.158729 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:17:47.166067 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-8b401959-b40f-457e-85a3-89364d1f0d06 req-a1e77054-a32c-45e6-a7e9-499a029ff712 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.166562 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-8b401959-b40f-457e-85a3-89364d1f0d06 req-a1e77054-a32c-45e6-a7e9-499a029ff712 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.178558 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-8b401959-b40f-457e-85a3-89364d1f0d06 req-a1e77054-a32c-45e6-a7e9-499a029ff712 service nova] Creating event network-vif-deleted:ee43fcfd-ae6a-49d2-8b5c-c4c92311f80e for instance 53fb2afb-af91-47f4-8428-1de4374d55a8 on hv-cinder-80390 Aug 10 05:17:47.183604 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-8b401959-b40f-457e-85a3-89364d1f0d06 req-a1e77054-a32c-45e6-a7e9-499a029ff712 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032605 Aug 10 05:17:47.184350 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 177/365] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:17:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:17:47.189938 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-6864e718-5c92-4b94-8cad-45875dec9de3 req-442dc23a-f41c-42b7-99ed-257d4cdd88b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55bd85f0-984b-44c8-8b35-45c2318ce955", "name": "network-vif-plugged", "status": "completed", "tag": "2e83aff6-4074-4b4c-840d-ddaba016bdab"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:47.191417 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:17:47.191417 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:17:47.199179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-6864e718-5c92-4b94-8cad-45875dec9de3 req-442dc23a-f41c-42b7-99ed-257d4cdd88b0 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.199616 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-6864e718-5c92-4b94-8cad-45875dec9de3 req-442dc23a-f41c-42b7-99ed-257d4cdd88b0 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.210226 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-6864e718-5c92-4b94-8cad-45875dec9de3 req-442dc23a-f41c-42b7-99ed-257d4cdd88b0 service nova] Creating event network-vif-plugged:2e83aff6-4074-4b4c-840d-ddaba016bdab for instance 55bd85f0-984b-44c8-8b35-45c2318ce955 on hv-cinder-80390 Aug 10 05:17:47.215376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-6864e718-5c92-4b94-8cad-45875dec9de3 req-442dc23a-f41c-42b7-99ed-257d4cdd88b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029345 Aug 10 05:17:47.217393 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 178/366] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:17:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:17:47.474562 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:47.475309 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:47.482921 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.483379 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.484368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.485469 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.486212 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b3e817f6-d144-4f86-8cb4-de5df890c544 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/action" status: 200 len: 32 microversion: 2.1 time: 0.426174 Aug 10 05:17:47.491222 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 189/367] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:47 2021] POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/action => generated 32 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:17:47.497293 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d50c7a00-16c6-47aa-8ffe-51c7e2c9e4d5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:47.498221 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d50c7a00-16c6-47aa-8ffe-51c7e2c9e4d5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:47.505478 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d50c7a00-16c6-47aa-8ffe-51c7e2c9e4d5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.505931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d50c7a00-16c6-47aa-8ffe-51c7e2c9e4d5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.507337 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d50c7a00-16c6-47aa-8ffe-51c7e2c9e4d5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.507805 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d50c7a00-16c6-47aa-8ffe-51c7e2c9e4d5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.521189 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.521958 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.522613 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lazy-loading 'fault' on Instance uuid 53fb2afb-af91-47f4-8428-1de4374d55a8 {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:17:47.578939 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c80843a900943ecb7d312088d9bf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4061dd7eb245a69b1eff088985076c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:47.586631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fc0d45a7-4e0b-4781-afbc-b144e3b4fd88 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 200 len: 1303 microversion: 2.1 time: 0.116425 Aug 10 05:17:47.590723 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 179/368] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:47 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:47.640048 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d50c7a00-16c6-47aa-8ffe-51c7e2c9e4d5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:47.647865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d50c7a00-16c6-47aa-8ffe-51c7e2c9e4d5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.154683 Aug 10 05:17:47.648457 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 190/369] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:47 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:47.857138 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:47.858461 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:47.866305 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.867509 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.868302 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.868737 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.910141 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bbfbfd0d-a8d1-4be6-b502-e953ac007460 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:47.910783 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-bbfbfd0d-a8d1-4be6-b502-e953ac007460 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:47.917380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bbfbfd0d-a8d1-4be6-b502-e953ac007460 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.917822 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bbfbfd0d-a8d1-4be6-b502-e953ac007460 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:47.918616 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bbfbfd0d-a8d1-4be6-b502-e953ac007460 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:47.919116 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bbfbfd0d-a8d1-4be6-b502-e953ac007460 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:48.050186 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-bbfbfd0d-a8d1-4be6-b502-e953ac007460 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:48.057838 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bbfbfd0d-a8d1-4be6-b502-e953ac007460 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1314 microversion: 2.1 time: 0.152472 Aug 10 05:17:48.058488 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 191/370] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:47 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:48.085669 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:48.093709 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:48.095845 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:48.097056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9935c662-4aa7-4d85-ae68-fbed4bca5fae tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.243766 Aug 10 05:17:48.097688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 180/371] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:47 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:48.606487 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:48.607387 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] [instance: 53fb2afb-af91-47f4-8428-1de4374d55a8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:48.614033 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:48.614561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:48.615375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:48.616065 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:48.630453 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] HTTP exception thrown: Instance 53fb2afb-af91-47f4-8428-1de4374d55a8 could not be found. Aug 10 05:17:48.631070 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] Returning 404 to user: Instance 53fb2afb-af91-47f4-8428-1de4374d55a8 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:17:48.631892 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a058127d-3c40-4919-a35f-4db0d1540fb0 tempest-VolumesActionsTest-2007020277 tempest-VolumesActionsTest-2007020277-project] 10.222.0.16 "GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8" status: 404 len: 111 microversion: 2.1 time: 0.029212 Aug 10 05:17:48.632414 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 192/372] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:48 2021] GET /compute/v2.1/servers/53fb2afb-af91-47f4-8428-1de4374d55a8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:17:48.664761 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6eb54715-115e-4514-93e6-5b8bcd400744 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:48.665363 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6eb54715-115e-4514-93e6-5b8bcd400744 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:48.671031 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6eb54715-115e-4514-93e6-5b8bcd400744 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:48.671476 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6eb54715-115e-4514-93e6-5b8bcd400744 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:48.672237 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6eb54715-115e-4514-93e6-5b8bcd400744 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:48.672672 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6eb54715-115e-4514-93e6-5b8bcd400744 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:48.792351 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6eb54715-115e-4514-93e6-5b8bcd400744 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:48.800116 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6eb54715-115e-4514-93e6-5b8bcd400744 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.139045 Aug 10 05:17:48.805009 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 181/373] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:48 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:49.074281 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f3278380-94fd-4816-aa09-b0338b33912c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:49.078733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f3278380-94fd-4816-aa09-b0338b33912c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:49.081782 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f3278380-94fd-4816-aa09-b0338b33912c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.082241 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f3278380-94fd-4816-aa09-b0338b33912c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.083457 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f3278380-94fd-4816-aa09-b0338b33912c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.083904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f3278380-94fd-4816-aa09-b0338b33912c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.116239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:49.117050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:49.125589 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.126360 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.128020 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.128668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.208335 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f3278380-94fd-4816-aa09-b0338b33912c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:49.216022 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f3278380-94fd-4816-aa09-b0338b33912c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1464 microversion: 2.1 time: 0.145414 Aug 10 05:17:49.216587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 193/374] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:49 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1464 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:49.254058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f2988321-778f-4a61-ba1c-ae10b99d9b01 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:49.254553 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f2988321-778f-4a61-ba1c-ae10b99d9b01 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:49.260520 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f2988321-778f-4a61-ba1c-ae10b99d9b01 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.262393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f2988321-778f-4a61-ba1c-ae10b99d9b01 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.262393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f2988321-778f-4a61-ba1c-ae10b99d9b01 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.262393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f2988321-778f-4a61-ba1c-ae10b99d9b01 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.269569 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:49.277282 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:49.279009 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:49.292273 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-619ffe70-ac4e-4042-a03b-e565f9e4ca72 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.169482 Aug 10 05:17:49.292273 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 182/375] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:49 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:49.294259 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f2988321-778f-4a61-ba1c-ae10b99d9b01 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:17:49.660080 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f2988321-778f-4a61-ba1c-ae10b99d9b01 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "DELETE /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 204 len: 0 microversion: 2.1 time: 0.409762 Aug 10 05:17:49.661152 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 194/376] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:17:49 2021] DELETE /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 05:17:49.670125 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1df4cdbd-af91-4078-8456-c857837594c6 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:49.670125 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1df4cdbd-af91-4078-8456-c857837594c6 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:49.676435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1df4cdbd-af91-4078-8456-c857837594c6 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.676889 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1df4cdbd-af91-4078-8456-c857837594c6 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.677666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1df4cdbd-af91-4078-8456-c857837594c6 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.678416 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1df4cdbd-af91-4078-8456-c857837594c6 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.804989 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1df4cdbd-af91-4078-8456-c857837594c6 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:49.817691 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-530eb368-8e0e-4610-af3b-e86b343a81be tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:49.818332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-530eb368-8e0e-4610-af3b-e86b343a81be tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:49.825455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1df4cdbd-af91-4078-8456-c857837594c6 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1470 microversion: 2.1 time: 0.157301 Aug 10 05:17:49.825455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 183/377] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:49 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:49.827531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-530eb368-8e0e-4610-af3b-e86b343a81be tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.828164 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-530eb368-8e0e-4610-af3b-e86b343a81be tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:49.829097 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-530eb368-8e0e-4610-af3b-e86b343a81be tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:49.829696 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-530eb368-8e0e-4610-af3b-e86b343a81be tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:50.030345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-530eb368-8e0e-4610-af3b-e86b343a81be tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:50.038161 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-530eb368-8e0e-4610-af3b-e86b343a81be tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.225593 Aug 10 05:17:50.038754 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 195/378] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:49 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:50.300228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:50.300829 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:50.306480 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:50.306958 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:50.307712 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:50.308147 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:50.429815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:50.437396 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:50.438921 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:50.440252 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6fdc5f14-b84e-431b-82f0-3fe789b2673a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.144431 Aug 10 05:17:50.441270 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 184/379] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:50 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:50.840594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2501fff9-bf84-477e-9159-4efe95a406c0 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:50.841227 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2501fff9-bf84-477e-9159-4efe95a406c0 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:50.847741 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2501fff9-bf84-477e-9159-4efe95a406c0 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:50.848180 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2501fff9-bf84-477e-9159-4efe95a406c0 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:50.848945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2501fff9-bf84-477e-9159-4efe95a406c0 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:50.849373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2501fff9-bf84-477e-9159-4efe95a406c0 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:50.970204 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2501fff9-bf84-477e-9159-4efe95a406c0 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:50.977523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2501fff9-bf84-477e-9159-4efe95a406c0 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1470 microversion: 2.1 time: 0.140933 Aug 10 05:17:50.978090 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 196/380] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:50 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1470 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:51.054554 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-304e5e7c-23a6-4c1c-81ec-dd09363fe713 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:51.055248 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-304e5e7c-23a6-4c1c-81ec-dd09363fe713 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:51.061202 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-304e5e7c-23a6-4c1c-81ec-dd09363fe713 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:51.061655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-304e5e7c-23a6-4c1c-81ec-dd09363fe713 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:51.062422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-304e5e7c-23a6-4c1c-81ec-dd09363fe713 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:51.063041 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-304e5e7c-23a6-4c1c-81ec-dd09363fe713 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:51.185729 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-304e5e7c-23a6-4c1c-81ec-dd09363fe713 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:51.197812 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-304e5e7c-23a6-4c1c-81ec-dd09363fe713 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.146835 Aug 10 05:17:51.198385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 185/381] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:51 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:51.457856 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:51.458647 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:51.464429 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:51.464869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:51.465639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:51.466054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:51.616692 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:51.623082 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:51.624570 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:51.625767 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-90852ea1-66e7-4ca2-974f-0021bd54ce8d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.171681 Aug 10 05:17:51.626323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 197/382] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:51 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:51.993809 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5e0ed913-fbd7-4ae1-abeb-445b7bb57054 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:51.994486 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5e0ed913-fbd7-4ae1-abeb-445b7bb57054 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:52.000198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e0ed913-fbd7-4ae1-abeb-445b7bb57054 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:52.000645 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e0ed913-fbd7-4ae1-abeb-445b7bb57054 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:52.001414 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e0ed913-fbd7-4ae1-abeb-445b7bb57054 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:52.002365 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e0ed913-fbd7-4ae1-abeb-445b7bb57054 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:52.151399 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-5e0ed913-fbd7-4ae1-abeb-445b7bb57054 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:52.159349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5e0ed913-fbd7-4ae1-abeb-445b7bb57054 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1470 microversion: 2.1 time: 0.169639 Aug 10 05:17:52.159927 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 186/383] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:51 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:52.215513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a328bd15-be47-42cd-a97f-4a1df2eec11f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:52.216147 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a328bd15-be47-42cd-a97f-4a1df2eec11f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:52.227057 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a328bd15-be47-42cd-a97f-4a1df2eec11f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:52.227057 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a328bd15-be47-42cd-a97f-4a1df2eec11f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:52.227057 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a328bd15-be47-42cd-a97f-4a1df2eec11f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:52.227057 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a328bd15-be47-42cd-a97f-4a1df2eec11f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:52.351587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a328bd15-be47-42cd-a97f-4a1df2eec11f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:52.359470 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a328bd15-be47-42cd-a97f-4a1df2eec11f tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.147505 Aug 10 05:17:52.360036 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 198/384] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:52 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:52.644706 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:52.645314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:52.651404 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:52.652016 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:52.652797 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:52.653240 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:52.772510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:52.780398 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:52.781950 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:52.783114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2356f2a6-b5d3-49fd-aa12-ad28b98e6d02 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.142784 Aug 10 05:17:52.783664 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 187/385] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:52 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:53.177158 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c728864d-a41b-4afa-a456-0f1ecce696ef tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:53.177767 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c728864d-a41b-4afa-a456-0f1ecce696ef tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:53.184210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c728864d-a41b-4afa-a456-0f1ecce696ef tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:53.184654 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c728864d-a41b-4afa-a456-0f1ecce696ef tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:53.185420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c728864d-a41b-4afa-a456-0f1ecce696ef tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:53.185878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c728864d-a41b-4afa-a456-0f1ecce696ef tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:53.307904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c728864d-a41b-4afa-a456-0f1ecce696ef tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:53.315540 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c728864d-a41b-4afa-a456-0f1ecce696ef tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1470 microversion: 2.1 time: 0.142670 Aug 10 05:17:53.316240 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 199/386] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:53 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1470 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:53.376526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ed01642a-790a-43a3-b028-3864790290cc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:53.377146 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ed01642a-790a-43a3-b028-3864790290cc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:53.382889 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ed01642a-790a-43a3-b028-3864790290cc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:53.383344 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ed01642a-790a-43a3-b028-3864790290cc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:53.384147 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ed01642a-790a-43a3-b028-3864790290cc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:53.384587 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ed01642a-790a-43a3-b028-3864790290cc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:53.502143 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ed01642a-790a-43a3-b028-3864790290cc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:53.509812 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ed01642a-790a-43a3-b028-3864790290cc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.137008 Aug 10 05:17:53.510368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 188/387] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:53 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:53.801152 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:53.801933 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:53.807901 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:53.808292 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:53.809067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:53.809505 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:53.941681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:53.951140 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:53.952859 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:53.954083 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b7bbcbc6-5eb3-430d-bf05-78dc65e511f4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.156808 Aug 10 05:17:53.955409 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 200/388] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:53 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:54.332308 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7b51ffc7-61bb-49c2-8f7f-50629ade383e tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:54.332888 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7b51ffc7-61bb-49c2-8f7f-50629ade383e tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:54.338784 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7b51ffc7-61bb-49c2-8f7f-50629ade383e tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:54.339232 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7b51ffc7-61bb-49c2-8f7f-50629ade383e tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:54.339990 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7b51ffc7-61bb-49c2-8f7f-50629ade383e tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:54.340422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7b51ffc7-61bb-49c2-8f7f-50629ade383e tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:54.461780 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7b51ffc7-61bb-49c2-8f7f-50629ade383e tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:54.469705 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7b51ffc7-61bb-49c2-8f7f-50629ade383e tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1470 microversion: 2.1 time: 0.141270 Aug 10 05:17:54.470635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 189/389] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:54 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1470 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:54.526421 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f0f20b44-3291-40bf-9255-54945eb16450 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:54.527057 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f0f20b44-3291-40bf-9255-54945eb16450 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:54.533973 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f0f20b44-3291-40bf-9255-54945eb16450 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:54.533973 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f0f20b44-3291-40bf-9255-54945eb16450 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:54.533973 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f0f20b44-3291-40bf-9255-54945eb16450 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:54.533973 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f0f20b44-3291-40bf-9255-54945eb16450 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:54.687403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f0f20b44-3291-40bf-9255-54945eb16450 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:54.699270 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f0f20b44-3291-40bf-9255-54945eb16450 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.176608 Aug 10 05:17:54.703135 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 201/390] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:54 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:54.972756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:54.973793 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:54.988832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:54.989665 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:54.990750 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:54.998415 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:55.242622 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:55.260480 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:55.268513 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:55.269719 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ed8d5e58-d368-491d-9bd1-af8bffd69048 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.301492 Aug 10 05:17:55.271275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 190/391] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:54 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:55.487367 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6c6c8d12-1483-4d5b-8147-9978b3fa2fe8 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:55.488222 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6c6c8d12-1483-4d5b-8147-9978b3fa2fe8 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:55.495472 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6c6c8d12-1483-4d5b-8147-9978b3fa2fe8 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:55.496237 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6c6c8d12-1483-4d5b-8147-9978b3fa2fe8 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:55.497274 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6c6c8d12-1483-4d5b-8147-9978b3fa2fe8 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:55.498166 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6c6c8d12-1483-4d5b-8147-9978b3fa2fe8 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:55.614199 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6c6c8d12-1483-4d5b-8147-9978b3fa2fe8 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:55.635488 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6c6c8d12-1483-4d5b-8147-9978b3fa2fe8 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1428 microversion: 2.1 time: 0.152047 Aug 10 05:17:55.636107 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-0789ba85-8bb9-47c9-87e5-73fb7955580f req-2c2e3703-2b89-4562-aab0-d51f744a6830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55bd85f0-984b-44c8-8b35-45c2318ce955", "name": "network-vif-deleted", "tag": "2e83aff6-4074-4b4c-840d-ddaba016bdab"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:55.637962 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 202/392] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:55 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1428 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:55.648763 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:17:55.648763 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:17:55.661377 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-0789ba85-8bb9-47c9-87e5-73fb7955580f req-2c2e3703-2b89-4562-aab0-d51f744a6830 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:55.661983 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-0789ba85-8bb9-47c9-87e5-73fb7955580f req-2c2e3703-2b89-4562-aab0-d51f744a6830 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:55.681709 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-0789ba85-8bb9-47c9-87e5-73fb7955580f req-2c2e3703-2b89-4562-aab0-d51f744a6830 service nova] Creating event network-vif-deleted:2e83aff6-4074-4b4c-840d-ddaba016bdab for instance 55bd85f0-984b-44c8-8b35-45c2318ce955 on hv-cinder-80390 Aug 10 05:17:55.696344 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-0789ba85-8bb9-47c9-87e5-73fb7955580f req-2c2e3703-2b89-4562-aab0-d51f744a6830 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071448 Aug 10 05:17:55.697256 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 191/393] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:17:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:17:55.721767 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-59dc471b-ecbe-437a-b4aa-cbbfa4c17868 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:55.723351 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-59dc471b-ecbe-437a-b4aa-cbbfa4c17868 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:55.731733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-59dc471b-ecbe-437a-b4aa-cbbfa4c17868 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:55.732540 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-59dc471b-ecbe-437a-b4aa-cbbfa4c17868 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:55.733802 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-59dc471b-ecbe-437a-b4aa-cbbfa4c17868 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:55.734494 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-59dc471b-ecbe-437a-b4aa-cbbfa4c17868 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:55.911557 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-df2c2b9c-de2c-4dfb-b4c1-a7f9d3faadc6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:17:55.920402 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df2c2b9c-de2c-4dfb-b4c1-a7f9d3faadc6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:55.920867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df2c2b9c-de2c-4dfb-b4c1-a7f9d3faadc6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:55.945651 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-59dc471b-ecbe-437a-b4aa-cbbfa4c17868 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:55.964163 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-59dc471b-ecbe-437a-b4aa-cbbfa4c17868 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.247562 Aug 10 05:17:55.976260 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 203/394] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:55 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:55.984711 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-df2c2b9c-de2c-4dfb-b4c1-a7f9d3faadc6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Going to try to stop instance {{(pid=108137) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 10 05:17:56.289765 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:56.290704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:56.296838 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.297293 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:56.298065 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.299090 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:56.390271 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-df2c2b9c-de2c-4dfb-b4c1-a7f9d3faadc6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 202 len: 0 microversion: 2.1 time: 0.482902 Aug 10 05:17:56.391496 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 192/395] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:17:55 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:17:56.400091 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a54a64e0-bf4c-4153-b01d-bdbf146f11d0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:56.401190 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a54a64e0-bf4c-4153-b01d-bdbf146f11d0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:56.408506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a54a64e0-bf4c-4153-b01d-bdbf146f11d0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.410655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a54a64e0-bf4c-4153-b01d-bdbf146f11d0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:56.410655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a54a64e0-bf4c-4153-b01d-bdbf146f11d0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.410655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a54a64e0-bf4c-4153-b01d-bdbf146f11d0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:56.442195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:56.451050 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:56.452908 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:56.455484 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7f85b8ad-a545-4629-987e-0a42f6d0c6ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.168774 Aug 10 05:17:56.456399 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 204/396] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:56 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:17:56.571950 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a54a64e0-bf4c-4153-b01d-bdbf146f11d0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:56.581314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a54a64e0-bf4c-4153-b01d-bdbf146f11d0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.185673 Aug 10 05:17:56.586625 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 193/397] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:56 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:56.661623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:56.663007 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:56.669599 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.670278 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:56.671292 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.671907 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:56.713114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.713580 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:56.714035 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lazy-loading 'fault' on Instance uuid 55bd85f0-984b-44c8-8b35-45c2318ce955 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:17:56.782666 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:56.787047 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-46b5414b-44bc-4254-84ac-f4a29b56e80a tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1304 microversion: 2.1 time: 0.137552 Aug 10 05:17:56.787612 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 205/398] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:56 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:56.981274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fbfbea29-01f5-4909-aae9-0a8274a17a64 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:56.982685 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fbfbea29-01f5-4909-aae9-0a8274a17a64 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:56.989062 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fbfbea29-01f5-4909-aae9-0a8274a17a64 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.989600 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fbfbea29-01f5-4909-aae9-0a8274a17a64 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:56.990380 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fbfbea29-01f5-4909-aae9-0a8274a17a64 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:56.990837 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fbfbea29-01f5-4909-aae9-0a8274a17a64 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:57.116215 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fbfbea29-01f5-4909-aae9-0a8274a17a64 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:57.125254 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fbfbea29-01f5-4909-aae9-0a8274a17a64 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.147803 Aug 10 05:17:57.126093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 194/399] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:56 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:57.530711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:57.530711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:57.530711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:57.530711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:57.531815 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:57.531815 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:57.599293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-826cf406-a5cc-436f-81e6-5fd35862bd81 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:57.603018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-826cf406-a5cc-436f-81e6-5fd35862bd81 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:57.606285 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-826cf406-a5cc-436f-81e6-5fd35862bd81 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:57.606781 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-826cf406-a5cc-436f-81e6-5fd35862bd81 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:57.607700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-826cf406-a5cc-436f-81e6-5fd35862bd81 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:57.608197 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-826cf406-a5cc-436f-81e6-5fd35862bd81 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:57.646054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:57.654192 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:57.655788 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:57.656933 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-dbb72f9e-0c58-498c-be26-fcba089fa985 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.180989 Aug 10 05:17:57.657561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 206/400] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:57 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:57.733376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-826cf406-a5cc-436f-81e6-5fd35862bd81 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:57.741853 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-826cf406-a5cc-436f-81e6-5fd35862bd81 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.146788 Aug 10 05:17:57.742876 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 195/401] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:57 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:57.803816 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:57.805053 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:57.812999 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:57.813729 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:57.815128 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:57.815634 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:57.863231 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:57.863515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:57.864140 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lazy-loading 'fault' on Instance uuid 55bd85f0-984b-44c8-8b35-45c2318ce955 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:17:57.913514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:57.921988 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1e646919-f1cb-45ae-8ed7-554a8e44bbbd tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1304 microversion: 2.1 time: 0.121912 Aug 10 05:17:57.922554 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 207/402] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:57 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:58.143574 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8421c424-b2d5-4406-821f-2c4e5066342d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:58.144156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8421c424-b2d5-4406-821f-2c4e5066342d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:58.149931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8421c424-b2d5-4406-821f-2c4e5066342d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.150378 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8421c424-b2d5-4406-821f-2c4e5066342d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.151241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8421c424-b2d5-4406-821f-2c4e5066342d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.151931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8421c424-b2d5-4406-821f-2c4e5066342d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.305091 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8421c424-b2d5-4406-821f-2c4e5066342d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:58.314117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8421c424-b2d5-4406-821f-2c4e5066342d tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.175019 Aug 10 05:17:58.315458 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 196/403] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:58 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:58.677280 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:58.677891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:58.684681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.685131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.685913 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.686381 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.760361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f9e7f07a-ad3b-4ab6-801f-91725fdb4ed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:58.761455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f9e7f07a-ad3b-4ab6-801f-91725fdb4ed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:58.783486 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f9e7f07a-ad3b-4ab6-801f-91725fdb4ed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.786384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f9e7f07a-ad3b-4ab6-801f-91725fdb4ed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.787506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f9e7f07a-ad3b-4ab6-801f-91725fdb4ed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.789925 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f9e7f07a-ad3b-4ab6-801f-91725fdb4ed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.816893 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:58.825328 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:58.826870 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:58.828756 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0a01262c-b54b-4d5e-95f8-4836dd443722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.154737 Aug 10 05:17:58.838622 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 208/404] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:58 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:17:58.937856 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f9e7f07a-ad3b-4ab6-801f-91725fdb4ed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:58.942728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:58.946221 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:58.947152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f9e7f07a-ad3b-4ab6-801f-91725fdb4ed5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.190915 Aug 10 05:17:58.955124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 197/405] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:58 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:58.957084 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.957757 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.958953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.959491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.995853 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:58.996302 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:58.996746 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lazy-loading 'fault' on Instance uuid 55bd85f0-984b-44c8-8b35-45c2318ce955 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:17:59.040262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd32fe141a547368b7c16df3156aa16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ccf4a61cc694f948205f646df3c3622', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:59.050839 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-71f372a8-866d-4f1f-bd10-037d5037584c tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 200 len: 1304 microversion: 2.1 time: 0.113412 Aug 10 05:17:59.052117 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 209/406] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:58 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:17:59.331979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0a705354-58fd-4d7e-95cd-55742c2663ae tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:59.332669 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0a705354-58fd-4d7e-95cd-55742c2663ae tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:59.338768 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a705354-58fd-4d7e-95cd-55742c2663ae tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:59.339293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a705354-58fd-4d7e-95cd-55742c2663ae tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:59.340430 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a705354-58fd-4d7e-95cd-55742c2663ae tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:59.341125 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a705354-58fd-4d7e-95cd-55742c2663ae tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:59.482045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0a705354-58fd-4d7e-95cd-55742c2663ae tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:17:59.491287 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0a705354-58fd-4d7e-95cd-55742c2663ae tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.163221 Aug 10 05:17:59.492052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 198/407] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:59 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:17:59.855342 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:59.857574 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:59.879280 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:59.879875 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:59.880686 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:59.881137 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:17:59.964945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-70362b42-3ca4-4add-93c0-e8c86049f427 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:17:59.966260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-70362b42-3ca4-4add-93c0-e8c86049f427 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:17:59.997172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-70362b42-3ca4-4add-93c0-e8c86049f427 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:17:59.998075 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-70362b42-3ca4-4add-93c0-e8c86049f427 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:00.002003 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-70362b42-3ca4-4add-93c0-e8c86049f427 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:00.002989 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-70362b42-3ca4-4add-93c0-e8c86049f427 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:00.083404 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:00.092629 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:00.096352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:00.097916 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4e038075-ad5c-4468-b311-71eaf2dacdb8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.254118 Aug 10 05:18:00.110836 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 210/408] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:17:59 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:00.117315 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:00.119288 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] [instance: 55bd85f0-984b-44c8-8b35-45c2318ce955] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:00.129084 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:00.130012 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:00.131109 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:00.131789 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:00.222171 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] HTTP exception thrown: Instance 55bd85f0-984b-44c8-8b35-45c2318ce955 could not be found. Aug 10 05:18:00.222171 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] Returning 404 to user: Instance 55bd85f0-984b-44c8-8b35-45c2318ce955 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:18:00.222171 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bf1e2657-f680-4b01-a334-4d53570d9998 tempest-VolumesNegativeTest-173650545 tempest-VolumesNegativeTest-173650545-project] 10.222.0.16 "GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955" status: 404 len: 111 microversion: 2.1 time: 0.097510 Aug 10 05:18:00.278614 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 211/409] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:00 2021] GET /compute/v2.1/servers/55bd85f0-984b-44c8-8b35-45c2318ce955 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:18:00.398242 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-70362b42-3ca4-4add-93c0-e8c86049f427 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:00.409071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-70362b42-3ca4-4add-93c0-e8c86049f427 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.448491 Aug 10 05:18:00.409532 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 199/410] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:17:59 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:00.509092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a7d123a1-67b2-463e-881a-2bbc41d99edc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:00.512340 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a7d123a1-67b2-463e-881a-2bbc41d99edc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:00.516384 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a7d123a1-67b2-463e-881a-2bbc41d99edc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:00.517564 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a7d123a1-67b2-463e-881a-2bbc41d99edc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:00.518857 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a7d123a1-67b2-463e-881a-2bbc41d99edc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:00.519569 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a7d123a1-67b2-463e-881a-2bbc41d99edc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:00.663038 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a7d123a1-67b2-463e-881a-2bbc41d99edc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:00.670809 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a7d123a1-67b2-463e-881a-2bbc41d99edc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.165764 Aug 10 05:18:00.675267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 212/411] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:00 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:01.118932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:01.120621 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:01.127668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:01.128167 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:01.129478 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:01.129934 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:01.266464 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:01.275266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:01.276819 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:01.277955 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7ac227d0-1cee-4026-9422-556aa646d322 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.164329 Aug 10 05:18:01.278678 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 200/412] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:01 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:01.425619 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0efa1634-368f-44d7-bd8a-7ea7cc976df1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:01.427064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0efa1634-368f-44d7-bd8a-7ea7cc976df1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:01.435903 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0efa1634-368f-44d7-bd8a-7ea7cc976df1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:01.437480 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0efa1634-368f-44d7-bd8a-7ea7cc976df1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:01.441230 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0efa1634-368f-44d7-bd8a-7ea7cc976df1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:01.441886 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0efa1634-368f-44d7-bd8a-7ea7cc976df1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:01.624131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0efa1634-368f-44d7-bd8a-7ea7cc976df1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:01.643113 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0efa1634-368f-44d7-bd8a-7ea7cc976df1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.221124 Aug 10 05:18:01.653078 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 213/413] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:01 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:01.688125 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fe39b679-1a72-4570-ac42-9b69a80874df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:01.689942 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fe39b679-1a72-4570-ac42-9b69a80874df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:01.696061 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fe39b679-1a72-4570-ac42-9b69a80874df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:01.696517 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fe39b679-1a72-4570-ac42-9b69a80874df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:01.697297 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fe39b679-1a72-4570-ac42-9b69a80874df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:01.697912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fe39b679-1a72-4570-ac42-9b69a80874df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:01.843286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fe39b679-1a72-4570-ac42-9b69a80874df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:01.851872 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fe39b679-1a72-4570-ac42-9b69a80874df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.167361 Aug 10 05:18:01.862210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 201/414] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:01 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:02.298597 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:02.299334 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:02.305652 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:02.306283 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:02.307325 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:02.307826 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:02.440594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:02.450780 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:02.452350 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:02.453929 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d05334fa-11eb-40e0-b751-ecdb29168eb1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.158853 Aug 10 05:18:02.455902 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 214/415] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:02 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:02.660357 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-669a2851-7807-4977-a105-5d9634c87045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:02.661076 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-669a2851-7807-4977-a105-5d9634c87045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:02.667860 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-669a2851-7807-4977-a105-5d9634c87045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:02.668312 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-669a2851-7807-4977-a105-5d9634c87045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:02.669097 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-669a2851-7807-4977-a105-5d9634c87045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:02.669668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-669a2851-7807-4977-a105-5d9634c87045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:02.816080 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-669a2851-7807-4977-a105-5d9634c87045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:02.827777 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-669a2851-7807-4977-a105-5d9634c87045 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.171133 Aug 10 05:18:02.838020 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 202/416] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:02 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:02.869368 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-58692a3e-2e95-4972-88e7-e0d7c0c68c69 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:02.869986 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-58692a3e-2e95-4972-88e7-e0d7c0c68c69 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:02.878925 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-58692a3e-2e95-4972-88e7-e0d7c0c68c69 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:02.879782 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-58692a3e-2e95-4972-88e7-e0d7c0c68c69 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:02.881307 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-58692a3e-2e95-4972-88e7-e0d7c0c68c69 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:02.882131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-58692a3e-2e95-4972-88e7-e0d7c0c68c69 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:03.019072 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-58692a3e-2e95-4972-88e7-e0d7c0c68c69 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:03.027345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-58692a3e-2e95-4972-88e7-e0d7c0c68c69 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.161854 Aug 10 05:18:03.037918 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 215/417] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:02 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:03.474117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:03.474662 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:03.481476 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:03.481921 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:03.482722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:03.483155 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:03.629563 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:03.638184 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:03.639815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:03.641012 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fa39e992-655e-4438-b083-43bc48f91b70 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.170811 Aug 10 05:18:03.653469 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 203/418] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:03 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:03.844658 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ab10d5e2-6e5f-4d8f-b68b-035ac4407bb5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:03.845318 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ab10d5e2-6e5f-4d8f-b68b-035ac4407bb5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:03.851349 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ab10d5e2-6e5f-4d8f-b68b-035ac4407bb5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:03.851864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ab10d5e2-6e5f-4d8f-b68b-035ac4407bb5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:03.852702 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ab10d5e2-6e5f-4d8f-b68b-035ac4407bb5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:03.853209 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ab10d5e2-6e5f-4d8f-b68b-035ac4407bb5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:04.014445 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ab10d5e2-6e5f-4d8f-b68b-035ac4407bb5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:04.023147 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ab10d5e2-6e5f-4d8f-b68b-035ac4407bb5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.182112 Aug 10 05:18:04.024327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 216/419] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:03 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:04.044645 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a28c0d48-a148-4cb2-8af3-85ecd65ed901 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:04.046055 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a28c0d48-a148-4cb2-8af3-85ecd65ed901 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:04.053396 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a28c0d48-a148-4cb2-8af3-85ecd65ed901 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:04.054064 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a28c0d48-a148-4cb2-8af3-85ecd65ed901 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:04.055568 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a28c0d48-a148-4cb2-8af3-85ecd65ed901 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:04.056214 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a28c0d48-a148-4cb2-8af3-85ecd65ed901 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:04.230346 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a28c0d48-a148-4cb2-8af3-85ecd65ed901 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:04.242864 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a28c0d48-a148-4cb2-8af3-85ecd65ed901 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.201743 Aug 10 05:18:04.252905 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 204/420] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:04 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:04.660806 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:04.661413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:04.669994 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:04.670450 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:04.671265 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:04.671702 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:04.836667 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:04.856401 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:04.858334 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:04.864492 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1f2337a7-7f6b-46b8-aede-3bf8bd416632 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.207555 Aug 10 05:18:04.865208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 217/421] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:04 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:05.046463 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fd2f7d85-0d27-4c00-91d4-a6d30b9ad37c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:05.047710 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fd2f7d85-0d27-4c00-91d4-a6d30b9ad37c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:05.055364 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fd2f7d85-0d27-4c00-91d4-a6d30b9ad37c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:05.056096 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fd2f7d85-0d27-4c00-91d4-a6d30b9ad37c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:05.057027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fd2f7d85-0d27-4c00-91d4-a6d30b9ad37c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:05.057575 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fd2f7d85-0d27-4c00-91d4-a6d30b9ad37c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:05.200464 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fd2f7d85-0d27-4c00-91d4-a6d30b9ad37c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:05.208975 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fd2f7d85-0d27-4c00-91d4-a6d30b9ad37c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.168738 Aug 10 05:18:05.209544 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 205/422] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:05 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:05.260820 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7174b9e0-a92d-4ed5-a4b2-5a608f85dfdc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:05.261445 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7174b9e0-a92d-4ed5-a4b2-5a608f85dfdc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:05.267959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7174b9e0-a92d-4ed5-a4b2-5a608f85dfdc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:05.268634 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7174b9e0-a92d-4ed5-a4b2-5a608f85dfdc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:05.269598 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7174b9e0-a92d-4ed5-a4b2-5a608f85dfdc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:05.270194 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7174b9e0-a92d-4ed5-a4b2-5a608f85dfdc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:05.432314 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7174b9e0-a92d-4ed5-a4b2-5a608f85dfdc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:05.442308 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7174b9e0-a92d-4ed5-a4b2-5a608f85dfdc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.185306 Aug 10 05:18:05.443300 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 218/423] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:05 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:05.882896 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:05.883509 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:05.889361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:05.889815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:05.890603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:05.891045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:06.008419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:06.016185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:06.018414 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:06.019602 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-de624498-bbec-49ea-be8f-925d85c5c4b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.140478 Aug 10 05:18:06.020223 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 206/424] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:05 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:06.226483 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-85e5de98-2838-40b6-8280-f428e65355f0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:06.227113 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-85e5de98-2838-40b6-8280-f428e65355f0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:06.232883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-85e5de98-2838-40b6-8280-f428e65355f0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:06.233326 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-85e5de98-2838-40b6-8280-f428e65355f0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:06.234080 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-85e5de98-2838-40b6-8280-f428e65355f0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:06.234510 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-85e5de98-2838-40b6-8280-f428e65355f0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:06.353825 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-85e5de98-2838-40b6-8280-f428e65355f0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:06.362793 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-85e5de98-2838-40b6-8280-f428e65355f0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.139408 Aug 10 05:18:06.363390 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 219/425] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:06 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:06.460428 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7af748a2-aadd-4fe4-ba94-0668521e7ee1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:06.461694 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7af748a2-aadd-4fe4-ba94-0668521e7ee1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:06.467925 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7af748a2-aadd-4fe4-ba94-0668521e7ee1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:06.468596 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7af748a2-aadd-4fe4-ba94-0668521e7ee1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:06.470141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7af748a2-aadd-4fe4-ba94-0668521e7ee1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:06.470809 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7af748a2-aadd-4fe4-ba94-0668521e7ee1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:06.636446 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7af748a2-aadd-4fe4-ba94-0668521e7ee1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:06.653362 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7af748a2-aadd-4fe4-ba94-0668521e7ee1 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.196337 Aug 10 05:18:06.654285 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 207/426] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:06 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:07.043524 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:07.046196 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:07.053958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:07.054811 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:07.055895 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:07.056540 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:07.217918 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:07.226064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:07.227865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:07.234131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-00286554-33d7-4777-af0a-7cbb3ebc2fa1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.198840 Aug 10 05:18:07.234724 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 220/427] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:07 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:07.381290 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8a38c8c6-f82e-4413-be8d-abf8c989bc47 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:07.381989 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8a38c8c6-f82e-4413-be8d-abf8c989bc47 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:07.388435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8a38c8c6-f82e-4413-be8d-abf8c989bc47 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:07.388980 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8a38c8c6-f82e-4413-be8d-abf8c989bc47 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:07.389832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8a38c8c6-f82e-4413-be8d-abf8c989bc47 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:07.390269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8a38c8c6-f82e-4413-be8d-abf8c989bc47 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:07.535765 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8a38c8c6-f82e-4413-be8d-abf8c989bc47 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:07.547071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8a38c8c6-f82e-4413-be8d-abf8c989bc47 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.167702 Aug 10 05:18:07.547071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 208/428] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:07 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:07.670600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-77ff0621-28fc-45e8-bf8d-8ce3ed377cdb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:07.671225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-77ff0621-28fc-45e8-bf8d-8ce3ed377cdb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:07.677594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-77ff0621-28fc-45e8-bf8d-8ce3ed377cdb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:07.678047 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-77ff0621-28fc-45e8-bf8d-8ce3ed377cdb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:07.678875 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-77ff0621-28fc-45e8-bf8d-8ce3ed377cdb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:07.679276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-77ff0621-28fc-45e8-bf8d-8ce3ed377cdb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:07.817763 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-77ff0621-28fc-45e8-bf8d-8ce3ed377cdb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:07.826261 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-77ff0621-28fc-45e8-bf8d-8ce3ed377cdb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.159318 Aug 10 05:18:07.832632 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 221/429] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:07 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:08.253345 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:08.253951 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:08.259805 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:08.260253 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:08.261015 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:08.261449 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:08.390834 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:08.402534 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:08.406289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:08.406289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a4a4de5e-f097-473a-8782-e3bc666894b0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.156587 Aug 10 05:18:08.416687 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 209/430] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:08 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:08.566427 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-518a6ff4-6394-44d3-91fd-e837c2d4ce92 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:08.567083 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-518a6ff4-6394-44d3-91fd-e837c2d4ce92 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:08.573211 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-518a6ff4-6394-44d3-91fd-e837c2d4ce92 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:08.574063 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-518a6ff4-6394-44d3-91fd-e837c2d4ce92 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:08.575026 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-518a6ff4-6394-44d3-91fd-e837c2d4ce92 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:08.575728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-518a6ff4-6394-44d3-91fd-e837c2d4ce92 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:08.773378 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-518a6ff4-6394-44d3-91fd-e837c2d4ce92 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:08.781470 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-518a6ff4-6394-44d3-91fd-e837c2d4ce92 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.219622 Aug 10 05:18:08.785876 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 222/431] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:08 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:08.843514 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3b9a8c1c-cc5b-4f71-8efe-6ea265c28ac5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:08.844918 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3b9a8c1c-cc5b-4f71-8efe-6ea265c28ac5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:08.852107 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3b9a8c1c-cc5b-4f71-8efe-6ea265c28ac5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:08.852559 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3b9a8c1c-cc5b-4f71-8efe-6ea265c28ac5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:08.853336 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3b9a8c1c-cc5b-4f71-8efe-6ea265c28ac5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:08.853772 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3b9a8c1c-cc5b-4f71-8efe-6ea265c28ac5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:08.998445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3b9a8c1c-cc5b-4f71-8efe-6ea265c28ac5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:09.007193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3b9a8c1c-cc5b-4f71-8efe-6ea265c28ac5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1568 microversion: 2.1 time: 0.167250 Aug 10 05:18:09.007972 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 210/432] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:08 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:09.426944 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:09.427836 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:09.449643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:09.456328 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:09.456328 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:09.456328 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:09.634461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:09.645063 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:09.654461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:09.655813 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-18d937a1-970d-432c-a945-999871caf485 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.235014 Aug 10 05:18:09.656491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 223/433] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:09 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:09.803842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-018ce85f-c125-49a7-8050-c70fef0ec8e2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:09.804635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-018ce85f-c125-49a7-8050-c70fef0ec8e2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:09.813928 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-018ce85f-c125-49a7-8050-c70fef0ec8e2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:09.815459 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-018ce85f-c125-49a7-8050-c70fef0ec8e2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:09.816657 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-018ce85f-c125-49a7-8050-c70fef0ec8e2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:09.817597 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-018ce85f-c125-49a7-8050-c70fef0ec8e2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.024356 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f441aa7e-8549-4ca8-9e76-e2bebd3f892b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:10.025165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f441aa7e-8549-4ca8-9e76-e2bebd3f892b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:10.036708 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f441aa7e-8549-4ca8-9e76-e2bebd3f892b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.038831 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f441aa7e-8549-4ca8-9e76-e2bebd3f892b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.039719 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f441aa7e-8549-4ca8-9e76-e2bebd3f892b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.040512 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f441aa7e-8549-4ca8-9e76-e2bebd3f892b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.049790 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-018ce85f-c125-49a7-8050-c70fef0ec8e2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:10.069998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-018ce85f-c125-49a7-8050-c70fef0ec8e2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.271985 Aug 10 05:18:10.075395 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 211/434] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:09 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:10.225973 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f441aa7e-8549-4ca8-9e76-e2bebd3f892b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:10.237456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f441aa7e-8549-4ca8-9e76-e2bebd3f892b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1548 microversion: 2.1 time: 0.216978 Aug 10 05:18:10.238128 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 224/435] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:10 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1548 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:10.255066 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:10.255835 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:10.262066 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.262806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.263600 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.264258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.408931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] HTTP exception thrown: Cannot 'detach_volume' instance 087a4339-30e4-48c7-aae6-024174e2d953 while it is in vm_state rescued Aug 10 05:18:10.409689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Returning 409 to user: Cannot 'detach_volume' instance 087a4339-30e4-48c7-aae6-024174e2d953 while it is in vm_state rescued {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:18:10.410788 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9aacc717-899d-4d3c-8461-23a079a57809 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments/550ef900-c44d-4636-bbf6-a09fd56fb156" status: 409 len: 152 microversion: 2.1 time: 0.160373 Aug 10 05:18:10.411897 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 212/436] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:18:10 2021] DELETE /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments/550ef900-c44d-4636-bbf6-a09fd56fb156 => generated 152 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 05:18:10.420202 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3b1e4e96-c6a2-4bfd-886f-b32509caa794 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:10.423834 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3b1e4e96-c6a2-4bfd-886f-b32509caa794 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:10.427599 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b1e4e96-c6a2-4bfd-886f-b32509caa794 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.428049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b1e4e96-c6a2-4bfd-886f-b32509caa794 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.429011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b1e4e96-c6a2-4bfd-886f-b32509caa794 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.429662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b1e4e96-c6a2-4bfd-886f-b32509caa794 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.675112 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:10.675800 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:10.683644 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.684445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.685455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.686082 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.719725 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3b1e4e96-c6a2-4bfd-886f-b32509caa794 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/action" status: 202 len: 0 microversion: 2.1 time: 0.303013 Aug 10 05:18:10.726029 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 225/437] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:18:10 2021] POST /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:18:10.733065 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4ed130d7-0e7a-4f2f-9624-173b7b19dae8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:10.734613 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4ed130d7-0e7a-4f2f-9624-173b7b19dae8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:10.744818 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ed130d7-0e7a-4f2f-9624-173b7b19dae8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.745453 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ed130d7-0e7a-4f2f-9624-173b7b19dae8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.746354 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ed130d7-0e7a-4f2f-9624-173b7b19dae8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:10.746935 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ed130d7-0e7a-4f2f-9624-173b7b19dae8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:10.834257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:10.843847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:10.846518 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:10.848140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b0123f4c-4e89-45c0-98f3-9ddb957bf0b9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.177675 Aug 10 05:18:10.859775 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 213/438] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:10 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:18:10.886303 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4ed130d7-0e7a-4f2f-9624-173b7b19dae8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:10.899765 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4ed130d7-0e7a-4f2f-9624-173b7b19dae8 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1556 microversion: 2.1 time: 0.167214 Aug 10 05:18:10.901133 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 226/439] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:10 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:11.091973 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4d59e73e-aa80-496a-b249-e09d7d690381 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:11.097281 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4d59e73e-aa80-496a-b249-e09d7d690381 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:11.104303 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d59e73e-aa80-496a-b249-e09d7d690381 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:11.105140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d59e73e-aa80-496a-b249-e09d7d690381 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:11.106210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d59e73e-aa80-496a-b249-e09d7d690381 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:11.106883 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d59e73e-aa80-496a-b249-e09d7d690381 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:11.365722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4d59e73e-aa80-496a-b249-e09d7d690381 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:11.373593 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4d59e73e-aa80-496a-b249-e09d7d690381 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.285515 Aug 10 05:18:11.374156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 214/440] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:11 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:11.867643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:11.868274 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:11.874755 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:11.875205 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:11.875985 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:11.876436 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:11.913355 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-186617e5-6d31-47a7-8dd5-1b97524160f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:11.913958 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-186617e5-6d31-47a7-8dd5-1b97524160f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:11.921641 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-186617e5-6d31-47a7-8dd5-1b97524160f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:11.921847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-186617e5-6d31-47a7-8dd5-1b97524160f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:11.925848 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-186617e5-6d31-47a7-8dd5-1b97524160f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:11.926589 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-186617e5-6d31-47a7-8dd5-1b97524160f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:12.015021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:12.024517 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:12.026792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:12.028215 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4894e81e-4d4c-428c-aab3-17b68e7a4bf7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.164603 Aug 10 05:18:12.039103 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 227/441] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:11 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:12.275691 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-186617e5-6d31-47a7-8dd5-1b97524160f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:12.284068 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-186617e5-6d31-47a7-8dd5-1b97524160f4 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1556 microversion: 2.1 time: 0.374161 Aug 10 05:18:12.284696 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 215/442] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:11 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1556 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:12.391634 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-522ebd41-ecb6-4c7c-89ea-ef8bb21dc399 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:12.392692 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-522ebd41-ecb6-4c7c-89ea-ef8bb21dc399 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:12.398535 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-522ebd41-ecb6-4c7c-89ea-ef8bb21dc399 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:12.399080 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-522ebd41-ecb6-4c7c-89ea-ef8bb21dc399 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:12.399844 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-522ebd41-ecb6-4c7c-89ea-ef8bb21dc399 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:12.400275 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-522ebd41-ecb6-4c7c-89ea-ef8bb21dc399 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:12.524851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-522ebd41-ecb6-4c7c-89ea-ef8bb21dc399 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:12.532680 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-522ebd41-ecb6-4c7c-89ea-ef8bb21dc399 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.144776 Aug 10 05:18:12.536804 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 228/443] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:12 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:13.047426 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:13.048027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:13.054271 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:13.054749 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:13.055503 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:13.055933 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:13.171579 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:13.180199 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:13.181707 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:13.182874 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3c6032f7-2dc0-40fa-a4cb-4a438292cab3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.139089 Aug 10 05:18:13.183419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 216/444] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:13 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:13.305438 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-77caffce-9adb-4c52-82c2-62bba69123f0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:13.306047 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-77caffce-9adb-4c52-82c2-62bba69123f0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:13.312005 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-77caffce-9adb-4c52-82c2-62bba69123f0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:13.312455 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-77caffce-9adb-4c52-82c2-62bba69123f0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:13.313220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-77caffce-9adb-4c52-82c2-62bba69123f0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:13.313656 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-77caffce-9adb-4c52-82c2-62bba69123f0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:13.432170 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-77caffce-9adb-4c52-82c2-62bba69123f0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:13.439894 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-77caffce-9adb-4c52-82c2-62bba69123f0 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1556 microversion: 2.1 time: 0.138075 Aug 10 05:18:13.440471 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 229/445] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:13 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1556 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:13.552337 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-98880c4f-6afb-4082-a416-08ed666abe44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:13.552982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-98880c4f-6afb-4082-a416-08ed666abe44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:13.558830 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-98880c4f-6afb-4082-a416-08ed666abe44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:13.559231 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-98880c4f-6afb-4082-a416-08ed666abe44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:13.560001 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-98880c4f-6afb-4082-a416-08ed666abe44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:13.560435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-98880c4f-6afb-4082-a416-08ed666abe44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:13.674866 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-98880c4f-6afb-4082-a416-08ed666abe44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:13.682423 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-98880c4f-6afb-4082-a416-08ed666abe44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.134343 Aug 10 05:18:13.683021 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 217/446] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:13 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:14.200710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:14.201319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:14.207911 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:14.208365 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:14.209138 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:14.209582 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:14.327442 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:14.335725 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:14.337220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:14.338348 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-13d86fe0-f8e4-4fa4-8394-72d6d586bb0c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.141263 Aug 10 05:18:14.338938 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 230/447] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:14 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:14.457516 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-434c2bd9-eab6-4bac-aae6-0f13c2c3735e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:14.458052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-434c2bd9-eab6-4bac-aae6-0f13c2c3735e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:14.464089 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-434c2bd9-eab6-4bac-aae6-0f13c2c3735e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:14.464535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-434c2bd9-eab6-4bac-aae6-0f13c2c3735e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:14.465296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-434c2bd9-eab6-4bac-aae6-0f13c2c3735e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:14.465726 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-434c2bd9-eab6-4bac-aae6-0f13c2c3735e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:14.588113 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-434c2bd9-eab6-4bac-aae6-0f13c2c3735e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:14.595742 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-434c2bd9-eab6-4bac-aae6-0f13c2c3735e tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1556 microversion: 2.1 time: 0.142576 Aug 10 05:18:14.596291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 218/448] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:14 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1556 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:14.699040 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8b8123fb-0d5c-42d1-b991-305f1be440a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:14.699654 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8b8123fb-0d5c-42d1-b991-305f1be440a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:14.705663 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8b8123fb-0d5c-42d1-b991-305f1be440a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:14.706117 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8b8123fb-0d5c-42d1-b991-305f1be440a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:14.706912 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8b8123fb-0d5c-42d1-b991-305f1be440a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:14.707352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8b8123fb-0d5c-42d1-b991-305f1be440a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:14.827572 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8b8123fb-0d5c-42d1-b991-305f1be440a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:14.835294 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8b8123fb-0d5c-42d1-b991-305f1be440a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.139904 Aug 10 05:18:14.837225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 231/449] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:14 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:15.356168 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:15.358156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:15.363079 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:15.363562 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:15.364463 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:15.364810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:15.499810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:15.508431 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:15.510062 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:15.511358 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-952c7f25-8f66-4bef-9f49-079b1edcf2a0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1746 microversion: 2.20 time: 0.158879 Aug 10 05:18:15.512035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 219/450] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:15 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:18:15.612544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-52814aed-2a2f-4714-92a2-fcc8eb1b7ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:15.613150 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-52814aed-2a2f-4714-92a2-fcc8eb1b7ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:15.619564 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52814aed-2a2f-4714-92a2-fcc8eb1b7ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:15.620174 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52814aed-2a2f-4714-92a2-fcc8eb1b7ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:15.620912 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52814aed-2a2f-4714-92a2-fcc8eb1b7ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:15.621352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52814aed-2a2f-4714-92a2-fcc8eb1b7ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:15.743067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-52814aed-2a2f-4714-92a2-fcc8eb1b7ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:15.751003 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-52814aed-2a2f-4714-92a2-fcc8eb1b7ffc tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1556 microversion: 2.1 time: 0.142184 Aug 10 05:18:15.752117 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 232/451] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:15 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1556 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:15.852267 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4a343e2f-ea87-4bc5-abe9-44f339bdafd2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:15.852798 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4a343e2f-ea87-4bc5-abe9-44f339bdafd2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:15.858480 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a343e2f-ea87-4bc5-abe9-44f339bdafd2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:15.858962 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a343e2f-ea87-4bc5-abe9-44f339bdafd2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:15.859726 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a343e2f-ea87-4bc5-abe9-44f339bdafd2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:15.860164 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a343e2f-ea87-4bc5-abe9-44f339bdafd2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:15.976973 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4a343e2f-ea87-4bc5-abe9-44f339bdafd2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:15.985806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4a343e2f-ea87-4bc5-abe9-44f339bdafd2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.137259 Aug 10 05:18:15.986957 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 220/452] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:15 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:16.530216 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:16.530846 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:16.537355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:16.537798 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:16.538561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:16.539017 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:16.656723 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:16.665022 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:16.666567 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:16.667710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-48d79820-22c9-4d73-b37f-f9c700f26a7b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1746 microversion: 2.20 time: 0.141447 Aug 10 05:18:16.668253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 233/453] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:16 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1746 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:16.767817 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a50de676-d11e-4638-afd5-6ee460699eee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:16.768439 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a50de676-d11e-4638-afd5-6ee460699eee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:16.775164 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a50de676-d11e-4638-afd5-6ee460699eee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:16.775625 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a50de676-d11e-4638-afd5-6ee460699eee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:16.776431 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a50de676-d11e-4638-afd5-6ee460699eee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:16.776872 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a50de676-d11e-4638-afd5-6ee460699eee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:16.901652 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a50de676-d11e-4638-afd5-6ee460699eee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:16.910228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a50de676-d11e-4638-afd5-6ee460699eee tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1556 microversion: 2.1 time: 0.146016 Aug 10 05:18:16.918653 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 221/454] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:16 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:17.002494 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0291899f-6618-4026-8828-09bcdb7e0393 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:17.004651 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0291899f-6618-4026-8828-09bcdb7e0393 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:17.009362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0291899f-6618-4026-8828-09bcdb7e0393 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:17.009794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0291899f-6618-4026-8828-09bcdb7e0393 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:17.010609 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0291899f-6618-4026-8828-09bcdb7e0393 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:17.011037 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0291899f-6618-4026-8828-09bcdb7e0393 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:17.137966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0291899f-6618-4026-8828-09bcdb7e0393 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:17.146438 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0291899f-6618-4026-8828-09bcdb7e0393 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.147673 Aug 10 05:18:17.147099 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 234/455] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:16 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:17.236877 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-72938aed-ffcc-4918-a24f-30aaae06bd1c req-7a5cfcfe-4f17-4104-a993-e3dcd4e28a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125a0f58-1cac-47b7-8486-e02530bcfb8f", "name": "network-vif-plugged", "status": "completed", "tag": "0e39f9de-97c4-4fa4-8a77-9dc21b2123a9"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:17.239211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:18:17.239211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:18:17.246410 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-72938aed-ffcc-4918-a24f-30aaae06bd1c req-7a5cfcfe-4f17-4104-a993-e3dcd4e28a95 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:17.246958 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-72938aed-ffcc-4918-a24f-30aaae06bd1c req-7a5cfcfe-4f17-4104-a993-e3dcd4e28a95 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:17.258557 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-72938aed-ffcc-4918-a24f-30aaae06bd1c req-7a5cfcfe-4f17-4104-a993-e3dcd4e28a95 service nova] Creating event network-vif-plugged:0e39f9de-97c4-4fa4-8a77-9dc21b2123a9 for instance 125a0f58-1cac-47b7-8486-e02530bcfb8f on hv-cinder-80390 Aug 10 05:18:17.263534 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-72938aed-ffcc-4918-a24f-30aaae06bd1c req-7a5cfcfe-4f17-4104-a993-e3dcd4e28a95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030252 Aug 10 05:18:17.264100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 222/456] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:18:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:18:17.685744 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:17.686350 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:17.692209 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:17.692652 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:17.693412 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:17.693846 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:17.815390 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:17.824337 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:17.825926 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:17.827139 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-91adf434-e752-4551-a8f0-303827fa5b3b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1746 microversion: 2.20 time: 0.145257 Aug 10 05:18:17.827694 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 235/457] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:17 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1746 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:17.927972 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-397b144f-df42-41d2-af68-ad489845f9b5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:17.928672 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-397b144f-df42-41d2-af68-ad489845f9b5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:17.934599 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-397b144f-df42-41d2-af68-ad489845f9b5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:17.935060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-397b144f-df42-41d2-af68-ad489845f9b5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:17.935897 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-397b144f-df42-41d2-af68-ad489845f9b5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:17.936413 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-397b144f-df42-41d2-af68-ad489845f9b5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:18.058175 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-397b144f-df42-41d2-af68-ad489845f9b5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:18.067481 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-397b144f-df42-41d2-af68-ad489845f9b5 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1562 microversion: 2.1 time: 0.143607 Aug 10 05:18:18.068450 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 223/458] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:17 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:18.152587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c58c1a73-1d53-4b7b-99ad-e518a3a04d2a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:18.153077 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c58c1a73-1d53-4b7b-99ad-e518a3a04d2a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:18.159104 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c58c1a73-1d53-4b7b-99ad-e518a3a04d2a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:18.160228 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c58c1a73-1d53-4b7b-99ad-e518a3a04d2a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:18.161726 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c58c1a73-1d53-4b7b-99ad-e518a3a04d2a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:18.162899 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c58c1a73-1d53-4b7b-99ad-e518a3a04d2a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:18.164666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ffc6a163-4624-4678-ac0b-946182aa34ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:18.165572 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ffc6a163-4624-4678-ac0b-946182aa34ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:18.171917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ffc6a163-4624-4678-ac0b-946182aa34ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:18.172369 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ffc6a163-4624-4678-ac0b-946182aa34ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:18.173137 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ffc6a163-4624-4678-ac0b-946182aa34ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:18.173592 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ffc6a163-4624-4678-ac0b-946182aa34ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:18.316789 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-c58c1a73-1d53-4b7b-99ad-e518a3a04d2a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lazy-loading 'services' on Instance uuid 087a4339-30e4-48c7-aae6-024174e2d953 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:18:18.320902 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ffc6a163-4624-4678-ac0b-946182aa34ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:18.329235 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ffc6a163-4624-4678-ac0b-946182aa34ba tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.168641 Aug 10 05:18:18.329810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 224/459] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:18 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:18.623319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c58c1a73-1d53-4b7b-99ad-e518a3a04d2a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments/550ef900-c44d-4636-bbf6-a09fd56fb156" status: 202 len: 0 microversion: 2.1 time: 0.469611 Aug 10 05:18:18.623319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 236/460] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:18:18 2021] DELETE /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments/550ef900-c44d-4636-bbf6-a09fd56fb156 => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:18:18.630850 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5d93411e-bfd1-46d0-9ed5-06f47ec2a243 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:18.631787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5d93411e-bfd1-46d0-9ed5-06f47ec2a243 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:18.638284 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5d93411e-bfd1-46d0-9ed5-06f47ec2a243 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:18.639317 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5d93411e-bfd1-46d0-9ed5-06f47ec2a243 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:18.640266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5d93411e-bfd1-46d0-9ed5-06f47ec2a243 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:18.640716 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5d93411e-bfd1-46d0-9ed5-06f47ec2a243 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:18.673015 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5d93411e-bfd1-46d0-9ed5-06f47ec2a243 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047906 Aug 10 05:18:18.673588 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 225/461] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:18:18 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:18:18.848220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:18.849579 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:18.857130 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:18.857838 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:18.858844 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:18.859446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:19.137059 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:19.148112 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:19.149601 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:19.150780 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b96e010c-ff1d-4a88-a389-26abc45ee235 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.307137 Aug 10 05:18:19.151650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 237/462] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:18 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:19.347519 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-24290e3b-0ce4-4ae1-9cf6-6b31ad31e901 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:19.348890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-24290e3b-0ce4-4ae1-9cf6-6b31ad31e901 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:19.356678 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-24290e3b-0ce4-4ae1-9cf6-6b31ad31e901 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:19.357353 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-24290e3b-0ce4-4ae1-9cf6-6b31ad31e901 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:19.358785 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-24290e3b-0ce4-4ae1-9cf6-6b31ad31e901 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:19.359740 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-24290e3b-0ce4-4ae1-9cf6-6b31ad31e901 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:19.528753 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-24290e3b-0ce4-4ae1-9cf6-6b31ad31e901 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:19.538211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-24290e3b-0ce4-4ae1-9cf6-6b31ad31e901 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.195394 Aug 10 05:18:19.540653 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 226/463] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:19 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:19.685317 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-53a8650a-b7b4-47f6-8d6b-b8904e302905 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:19.692221 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-53a8650a-b7b4-47f6-8d6b-b8904e302905 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:19.699610 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53a8650a-b7b4-47f6-8d6b-b8904e302905 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:19.700289 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53a8650a-b7b4-47f6-8d6b-b8904e302905 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:19.701223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53a8650a-b7b4-47f6-8d6b-b8904e302905 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:19.701809 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53a8650a-b7b4-47f6-8d6b-b8904e302905 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:19.739119 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-53a8650a-b7b4-47f6-8d6b-b8904e302905 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057823 Aug 10 05:18:19.739689 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 238/464] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:18:19 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:18:20.169176 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:20.170048 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:20.176692 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:20.177319 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:20.178257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:20.194435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:20.427776 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:20.438880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:20.441629 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:20.442980 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-16966067-f825-42d6-84f9-f52b4cc16309 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.277594 Aug 10 05:18:20.455300 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 227/465] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:20 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:18:20.559673 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f4bcea47-d8df-4793-8c79-c6e9038b0777 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:20.560793 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f4bcea47-d8df-4793-8c79-c6e9038b0777 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:20.570467 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4bcea47-d8df-4793-8c79-c6e9038b0777 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:20.571004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4bcea47-d8df-4793-8c79-c6e9038b0777 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:20.571804 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4bcea47-d8df-4793-8c79-c6e9038b0777 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:20.572344 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4bcea47-d8df-4793-8c79-c6e9038b0777 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:20.715065 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f4bcea47-d8df-4793-8c79-c6e9038b0777 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:20.724257 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f4bcea47-d8df-4793-8c79-c6e9038b0777 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.169145 Aug 10 05:18:20.727400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 239/466] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:20 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:20.750864 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-601505eb-8a37-4775-a217-a8b9affb66ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:20.752048 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-601505eb-8a37-4775-a217-a8b9affb66ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:20.760111 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-601505eb-8a37-4775-a217-a8b9affb66ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:20.760760 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-601505eb-8a37-4775-a217-a8b9affb66ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:20.762039 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-601505eb-8a37-4775-a217-a8b9affb66ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:20.767905 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-601505eb-8a37-4775-a217-a8b9affb66ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:20.824244 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-601505eb-8a37-4775-a217-a8b9affb66ff tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077270 Aug 10 05:18:20.825358 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 228/467] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:18:20 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:18:21.462020 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:21.462946 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:21.473513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:21.474191 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:21.475230 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:21.475869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:21.692994 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:21.708601 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:21.710426 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:21.711937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d16531a1-b6c1-4442-bcc6-c800efee669b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.253898 Aug 10 05:18:21.713271 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 240/468] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:21 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:21.744100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6ee046e9-56e9-4f19-bfe0-bb3759c6f0e4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:21.744100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6ee046e9-56e9-4f19-bfe0-bb3759c6f0e4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:21.751610 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6ee046e9-56e9-4f19-bfe0-bb3759c6f0e4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:21.754531 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6ee046e9-56e9-4f19-bfe0-bb3759c6f0e4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:21.757881 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6ee046e9-56e9-4f19-bfe0-bb3759c6f0e4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:21.758674 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6ee046e9-56e9-4f19-bfe0-bb3759c6f0e4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:21.936228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6ee046e9-56e9-4f19-bfe0-bb3759c6f0e4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:21.951449 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6ee046e9-56e9-4f19-bfe0-bb3759c6f0e4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.211013 Aug 10 05:18:21.952782 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 229/469] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:21 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:22.730255 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:22.731165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:22.736983 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:22.737429 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:22.738197 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:22.739179 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:22.930978 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:22.939516 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:22.942230 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:22.944102 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6668dbec-7b67-4238-a371-ec3845a3dfee tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.217666 Aug 10 05:18:22.944820 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 241/470] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:22 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:22.973966 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9fb607d7-9f5d-47c3-9d16-87b7cbd001e8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:22.974599 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9fb607d7-9f5d-47c3-9d16-87b7cbd001e8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:22.981345 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fb607d7-9f5d-47c3-9d16-87b7cbd001e8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:22.981802 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fb607d7-9f5d-47c3-9d16-87b7cbd001e8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:22.982607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fb607d7-9f5d-47c3-9d16-87b7cbd001e8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:22.983052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fb607d7-9f5d-47c3-9d16-87b7cbd001e8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:23.191298 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9fb607d7-9f5d-47c3-9d16-87b7cbd001e8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:23.199520 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9fb607d7-9f5d-47c3-9d16-87b7cbd001e8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.229874 Aug 10 05:18:23.210536 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 230/471] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:22 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:23.829259 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-65445c30-3af0-4f6e-837b-8069020f31df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:23.830390 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-65445c30-3af0-4f6e-837b-8069020f31df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:23.838794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-65445c30-3af0-4f6e-837b-8069020f31df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:23.839761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-65445c30-3af0-4f6e-837b-8069020f31df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:23.841740 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-65445c30-3af0-4f6e-837b-8069020f31df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:23.843251 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-65445c30-3af0-4f6e-837b-8069020f31df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:23.876285 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-65445c30-3af0-4f6e-837b-8069020f31df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:18:23.965235 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:23.966094 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:23.973622 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:23.976920 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:23.979772 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:23.983957 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:24.202569 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:24.211539 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:24.215375 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:24.216816 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0daa9361-83e6-402f-9afc-7699673255c4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.255232 Aug 10 05:18:24.228688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 231/472] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:23 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:18:24.233395 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ec49189b-e9ce-4f6a-b2a2-66d00421c3f6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:24.234300 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ec49189b-e9ce-4f6a-b2a2-66d00421c3f6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:24.244316 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ec49189b-e9ce-4f6a-b2a2-66d00421c3f6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:24.249104 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ec49189b-e9ce-4f6a-b2a2-66d00421c3f6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:24.255034 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ec49189b-e9ce-4f6a-b2a2-66d00421c3f6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:24.255034 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ec49189b-e9ce-4f6a-b2a2-66d00421c3f6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:24.303039 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-65445c30-3af0-4f6e-837b-8069020f31df tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 204 len: 0 microversion: 2.1 time: 0.478996 Aug 10 05:18:24.305533 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 242/473] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:18:23 2021] DELETE /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:18:24.311866 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-37a6c730-9035-4ef5-8ea5-0649b4190b86 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:24.312574 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-37a6c730-9035-4ef5-8ea5-0649b4190b86 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:24.327145 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-37a6c730-9035-4ef5-8ea5-0649b4190b86 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:24.328456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-37a6c730-9035-4ef5-8ea5-0649b4190b86 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:24.329460 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-37a6c730-9035-4ef5-8ea5-0649b4190b86 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:24.330628 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-37a6c730-9035-4ef5-8ea5-0649b4190b86 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:24.435035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ec49189b-e9ce-4f6a-b2a2-66d00421c3f6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:24.443210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ec49189b-e9ce-4f6a-b2a2-66d00421c3f6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1721 microversion: 2.1 time: 0.213295 Aug 10 05:18:24.452445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 232/474] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:24 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:24.539817 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-37a6c730-9035-4ef5-8ea5-0649b4190b86 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:24.550028 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-37a6c730-9035-4ef5-8ea5-0649b4190b86 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1508 microversion: 2.1 time: 0.242040 Aug 10 05:18:24.555258 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 243/475] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:24 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:25.235297 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:25.235918 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:25.243012 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:25.244924 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:25.244924 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:25.245522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:25.427376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:25.442948 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:25.445090 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:25.447320 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c8eabb7b-7e39-41f8-8b30-d909985930f2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.214869 Aug 10 05:18:25.448455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 233/476] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:25 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:25.465088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0f26f7a7-e8ea-4357-afad-0e0bf942c9f7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:25.465862 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0f26f7a7-e8ea-4357-afad-0e0bf942c9f7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:25.472156 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0f26f7a7-e8ea-4357-afad-0e0bf942c9f7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:25.473758 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0f26f7a7-e8ea-4357-afad-0e0bf942c9f7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:25.474751 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0f26f7a7-e8ea-4357-afad-0e0bf942c9f7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:25.475531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0f26f7a7-e8ea-4357-afad-0e0bf942c9f7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:25.588422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-178957a7-178a-4e7f-be9a-4ff447f0fd02 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:25.589222 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-178957a7-178a-4e7f-be9a-4ff447f0fd02 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:25.595974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-178957a7-178a-4e7f-be9a-4ff447f0fd02 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:25.599164 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-178957a7-178a-4e7f-be9a-4ff447f0fd02 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:25.600167 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-178957a7-178a-4e7f-be9a-4ff447f0fd02 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:25.603223 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-178957a7-178a-4e7f-be9a-4ff447f0fd02 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:25.788627 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-178957a7-178a-4e7f-be9a-4ff447f0fd02 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:25.803931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-178957a7-178a-4e7f-be9a-4ff447f0fd02 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1508 microversion: 2.1 time: 0.230674 Aug 10 05:18:25.805741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 234/477] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:25 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:25.983869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0f26f7a7-e8ea-4357-afad-0e0bf942c9f7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:25.997508 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0f26f7a7-e8ea-4357-afad-0e0bf942c9f7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1698 microversion: 2.1 time: 0.536016 Aug 10 05:18:26.002917 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 244/478] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:25 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1698 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:26.077859 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b40ee2fa-169b-4fc0-813d-804a79e306e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:26.088548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b40ee2fa-169b-4fc0-813d-804a79e306e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:26.089340 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b40ee2fa-169b-4fc0-813d-804a79e306e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:26.121126 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b40ee2fa-169b-4fc0-813d-804a79e306e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Going to try to start instance {{(pid=108137) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 10 05:18:26.466874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:26.467476 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:26.474197 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:26.474678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:26.475672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:26.476105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:26.666843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b40ee2fa-169b-4fc0-813d-804a79e306e7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 202 len: 0 microversion: 2.1 time: 0.590126 Aug 10 05:18:26.689144 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 235/479] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:18:26 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 0 bytes in 617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:18:26.699336 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d5687391-d5d3-4daf-b606-06022e2c84a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:26.700717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d5687391-d5d3-4daf-b606-06022e2c84a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:26.708583 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d5687391-d5d3-4daf-b606-06022e2c84a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:26.709291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d5687391-d5d3-4daf-b606-06022e2c84a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:26.710314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d5687391-d5d3-4daf-b606-06022e2c84a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:26.711086 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d5687391-d5d3-4daf-b606-06022e2c84a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:26.746631 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:26.757357 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:26.761526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:26.763955 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-92eb7e92-81d7-4a00-81f4-712e6cdeafef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.300870 Aug 10 05:18:26.765273 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 245/480] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:26 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:18:26.821272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-959f30a2-0ace-4702-a1de-c90ba2278e2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:26.822009 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-959f30a2-0ace-4702-a1de-c90ba2278e2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:26.830679 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-959f30a2-0ace-4702-a1de-c90ba2278e2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:26.835262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-959f30a2-0ace-4702-a1de-c90ba2278e2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:26.836163 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-959f30a2-0ace-4702-a1de-c90ba2278e2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:26.836904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-959f30a2-0ace-4702-a1de-c90ba2278e2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:26.969370 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d5687391-d5d3-4daf-b606-06022e2c84a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:26.983432 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d5687391-d5d3-4daf-b606-06022e2c84a6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1707 microversion: 2.1 time: 0.289566 Aug 10 05:18:26.984377 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 236/481] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:26 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1707 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:27.181611 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-959f30a2-0ace-4702-a1de-c90ba2278e2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:27.191016 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-959f30a2-0ace-4702-a1de-c90ba2278e2b tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1508 microversion: 2.1 time: 0.372746 Aug 10 05:18:27.201675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 246/482] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:26 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:27.771174 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-2c5177d9-2a1e-498e-9139-b62520a79a23 req-61ba01ad-b539-46be-8e29-ae887d02a209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39b2d03d-c431-46da-926e-49d6390dcacf", "name": "network-vif-deleted", "tag": "8ee89d93-e427-4a75-904d-bbb3508ade44"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:27.774121 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:18:27.774121 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:18:27.783541 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:27.784861 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:27.793446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:27.795964 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-2c5177d9-2a1e-498e-9139-b62520a79a23 req-61ba01ad-b539-46be-8e29-ae887d02a209 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:27.798486 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:27.798486 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:27.798486 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:27.799616 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-2c5177d9-2a1e-498e-9139-b62520a79a23 req-61ba01ad-b539-46be-8e29-ae887d02a209 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:27.826048 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-2c5177d9-2a1e-498e-9139-b62520a79a23 req-61ba01ad-b539-46be-8e29-ae887d02a209 service nova] Creating event network-vif-deleted:8ee89d93-e427-4a75-904d-bbb3508ade44 for instance 39b2d03d-c431-46da-926e-49d6390dcacf on hv-cinder-80390 Aug 10 05:18:27.840122 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-2c5177d9-2a1e-498e-9139-b62520a79a23 req-61ba01ad-b539-46be-8e29-ae887d02a209 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073134 Aug 10 05:18:27.845391 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 237/483] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:18:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:18:28.006783 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c8530fe3-fb37-4bb4-b9a3-b95e11dab965 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:28.008412 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c8530fe3-fb37-4bb4-b9a3-b95e11dab965 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:28.018917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c8530fe3-fb37-4bb4-b9a3-b95e11dab965 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:28.023483 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c8530fe3-fb37-4bb4-b9a3-b95e11dab965 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:28.024723 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c8530fe3-fb37-4bb4-b9a3-b95e11dab965 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:28.025367 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c8530fe3-fb37-4bb4-b9a3-b95e11dab965 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:28.252438 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c8530fe3-fb37-4bb4-b9a3-b95e11dab965 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:28.260974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c8530fe3-fb37-4bb4-b9a3-b95e11dab965 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1707 microversion: 2.1 time: 0.261771 Aug 10 05:18:28.271408 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 238/484] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:27 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1707 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:28.276379 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:28.277194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:28.291394 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:28.292182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:28.293208 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:28.294002 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:28.356773 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:28.357534 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:28.358250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lazy-loading 'fault' on Instance uuid 39b2d03d-c431-46da-926e-49d6390dcacf {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:18:28.417263 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:28.427854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-392918e6-c019-4e34-bdec-87e3ea31dcba tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 200 len: 1311 microversion: 2.1 time: 0.155035 Aug 10 05:18:28.428661 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 239/485] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:28 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 1311 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:28.460148 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:28.470360 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:28.472507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:28.478520 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-116a118d-2b1d-486f-95df-3381ba3eb8c6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.695065 Aug 10 05:18:28.479730 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 247/486] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:27 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:18:29.288400 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-81f007b0-c20d-4753-8ae5-73f40b31db7e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:29.289725 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-81f007b0-c20d-4753-8ae5-73f40b31db7e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:29.299327 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-81f007b0-c20d-4753-8ae5-73f40b31db7e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:29.299846 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-81f007b0-c20d-4753-8ae5-73f40b31db7e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:29.304197 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-81f007b0-c20d-4753-8ae5-73f40b31db7e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:29.304648 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-81f007b0-c20d-4753-8ae5-73f40b31db7e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:29.459299 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:29.459872 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 39b2d03d-c431-46da-926e-49d6390dcacf] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:29.472316 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:29.472788 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:29.475145 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:29.475792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:29.500864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] HTTP exception thrown: Instance 39b2d03d-c431-46da-926e-49d6390dcacf could not be found. Aug 10 05:18:29.501580 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Returning 404 to user: Instance 39b2d03d-c431-46da-926e-49d6390dcacf could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:18:29.502734 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-35c6d441-b095-4cae-844a-192c25d0d7eb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf" status: 404 len: 111 microversion: 2.1 time: 0.053903 Aug 10 05:18:29.503833 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 248/487] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:29 2021] GET /compute/v2.1/servers/39b2d03d-c431-46da-926e-49d6390dcacf => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:18:29.509695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:29.510740 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:29.518776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:29.518776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:29.518776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:29.519544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:29.545196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-81f007b0-c20d-4753-8ae5-73f40b31db7e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:29.561442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-81f007b0-c20d-4753-8ae5-73f40b31db7e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1707 microversion: 2.1 time: 0.276898 Aug 10 05:18:29.563462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 240/488] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:29 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1707 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:29.569331 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2006bfd2-75b8-4e68-b995-821637e38ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:29.570106 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2006bfd2-75b8-4e68-b995-821637e38ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:29.578967 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2006bfd2-75b8-4e68-b995-821637e38ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:29.579943 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2006bfd2-75b8-4e68-b995-821637e38ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:29.580987 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2006bfd2-75b8-4e68-b995-821637e38ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:29.581609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2006bfd2-75b8-4e68-b995-821637e38ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:29.699359 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2006bfd2-75b8-4e68-b995-821637e38ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Going to try to terminate instance {{(pid=108137) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:18:29.880453 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:29.923375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:29.941948 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:29.941948 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-52e5e6c9-ec49-4ab7-ae80-4bab2a3b638c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.428626 Aug 10 05:18:29.943863 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 249/489] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:29 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:30.580446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-815c701e-44b9-4465-b998-b41d04009013 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:30.581825 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-815c701e-44b9-4465-b998-b41d04009013 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:30.588484 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-815c701e-44b9-4465-b998-b41d04009013 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:30.589487 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-815c701e-44b9-4465-b998-b41d04009013 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:30.591021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-815c701e-44b9-4465-b998-b41d04009013 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:30.591615 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-815c701e-44b9-4465-b998-b41d04009013 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:30.714500 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2006bfd2-75b8-4e68-b995-821637e38ae7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "DELETE /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 204 len: 0 microversion: 2.1 time: 1.149183 Aug 10 05:18:30.715141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 241/490] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:18:29 2021] DELETE /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:18:30.743156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6dd789db-e307-46f1-81a2-a1b7958d4f4a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:30.743882 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6dd789db-e307-46f1-81a2-a1b7958d4f4a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:30.760780 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6dd789db-e307-46f1-81a2-a1b7958d4f4a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:30.764617 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6dd789db-e307-46f1-81a2-a1b7958d4f4a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:30.764617 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6dd789db-e307-46f1-81a2-a1b7958d4f4a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:30.766872 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6dd789db-e307-46f1-81a2-a1b7958d4f4a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:30.847766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-815c701e-44b9-4465-b998-b41d04009013 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:30.860953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-815c701e-44b9-4465-b998-b41d04009013 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1711 microversion: 2.1 time: 0.284258 Aug 10 05:18:30.861537 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 250/491] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:30 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1711 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:30.992267 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6dd789db-e307-46f1-81a2-a1b7958d4f4a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:31.000818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6dd789db-e307-46f1-81a2-a1b7958d4f4a tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.270629 Aug 10 05:18:31.001391 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 242/492] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:30 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:31.021062 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:31.021976 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:31.052013 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:31.052711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:31.053690 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:31.054293 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:31.291514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:31.302687 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:31.304524 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:31.306618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d8c61613-7261-4d59-a4de-d15136850043 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.291140 Aug 10 05:18:31.307720 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 251/493] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:31 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:32.024546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e93b57e6-8f8a-4cef-b980-509f2da73008 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:32.025163 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e93b57e6-8f8a-4cef-b980-509f2da73008 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:32.034063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e93b57e6-8f8a-4cef-b980-509f2da73008 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:32.039269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e93b57e6-8f8a-4cef-b980-509f2da73008 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:32.040432 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e93b57e6-8f8a-4cef-b980-509f2da73008 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:32.042248 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e93b57e6-8f8a-4cef-b980-509f2da73008 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:32.227945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e93b57e6-8f8a-4cef-b980-509f2da73008 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:32.239616 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e93b57e6-8f8a-4cef-b980-509f2da73008 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.219408 Aug 10 05:18:32.251100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 243/494] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:32 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:32.325068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:32.325624 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:32.332122 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:32.332491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:32.333484 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:32.334398 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:32.476656 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:32.485991 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:32.485991 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:32.487091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-30ec2bfa-2e9a-4820-a53e-5eb6143c674c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1741 microversion: 2.20 time: 0.165947 Aug 10 05:18:32.487640 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 252/495] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:32 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:33.257645 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a4f5d991-a356-429f-b051-c4b87fb6b646 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:33.261521 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a4f5d991-a356-429f-b051-c4b87fb6b646 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:33.265024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a4f5d991-a356-429f-b051-c4b87fb6b646 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:33.265478 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a4f5d991-a356-429f-b051-c4b87fb6b646 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:33.266426 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a4f5d991-a356-429f-b051-c4b87fb6b646 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:33.267052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a4f5d991-a356-429f-b051-c4b87fb6b646 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:33.416805 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a4f5d991-a356-429f-b051-c4b87fb6b646 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:33.424499 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a4f5d991-a356-429f-b051-c4b87fb6b646 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.170894 Aug 10 05:18:33.425080 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 244/496] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:33 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:33.511680 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:33.513071 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:33.519413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:33.520135 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:33.521118 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:33.521763 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:33.774828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:33.784107 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:33.786087 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:33.787930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7f104ae9-5aa8-4350-9987-7139e862757e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1723 microversion: 2.20 time: 0.284533 Aug 10 05:18:33.789071 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 253/497] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:33 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:34.441138 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-224d1b70-4313-4fb3-aa88-b6b736d5f9b7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:34.441839 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-224d1b70-4313-4fb3-aa88-b6b736d5f9b7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:34.450432 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-224d1b70-4313-4fb3-aa88-b6b736d5f9b7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:34.451065 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-224d1b70-4313-4fb3-aa88-b6b736d5f9b7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:34.452038 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-224d1b70-4313-4fb3-aa88-b6b736d5f9b7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:34.452473 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-224d1b70-4313-4fb3-aa88-b6b736d5f9b7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:34.703658 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-224d1b70-4313-4fb3-aa88-b6b736d5f9b7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:34.711452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-224d1b70-4313-4fb3-aa88-b6b736d5f9b7 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.274087 Aug 10 05:18:34.712262 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 245/498] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:34 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:34.816420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:34.817758 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:34.823969 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:34.824419 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:34.825386 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:34.825986 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:34.973850 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:34.981974 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:34.983528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:34.984690 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a7670923-e4ea-46dc-ad30-0176ad08dac0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1723 microversion: 2.20 time: 0.172069 Aug 10 05:18:34.985450 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 254/499] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:34 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:35.267345 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-ff5d353d-cb3f-4a52-9a0a-9c0ba8f6cff8 req-e44b179b-7233-40f6-88bf-5d08458fe3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125a0f58-1cac-47b7-8486-e02530bcfb8f", "name": "network-vif-unplugged", "status": "completed", "tag": "0e39f9de-97c4-4fa4-8a77-9dc21b2123a9"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:35.269141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:18:35.269141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:18:35.276928 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-ff5d353d-cb3f-4a52-9a0a-9c0ba8f6cff8 req-e44b179b-7233-40f6-88bf-5d08458fe3fd service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:35.277532 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-ff5d353d-cb3f-4a52-9a0a-9c0ba8f6cff8 req-e44b179b-7233-40f6-88bf-5d08458fe3fd service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:35.289137 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-ff5d353d-cb3f-4a52-9a0a-9c0ba8f6cff8 req-e44b179b-7233-40f6-88bf-5d08458fe3fd service nova] Creating event network-vif-unplugged:0e39f9de-97c4-4fa4-8a77-9dc21b2123a9 for instance 125a0f58-1cac-47b7-8486-e02530bcfb8f on hv-cinder-80390 Aug 10 05:18:35.294551 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-ff5d353d-cb3f-4a52-9a0a-9c0ba8f6cff8 req-e44b179b-7233-40f6-88bf-5d08458fe3fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031577 Aug 10 05:18:35.295168 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 246/500] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:18:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:18:35.729572 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2413a917-53f6-4863-b850-284a0f3ff9cd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:35.730297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2413a917-53f6-4863-b850-284a0f3ff9cd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:35.736610 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2413a917-53f6-4863-b850-284a0f3ff9cd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:35.737311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2413a917-53f6-4863-b850-284a0f3ff9cd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:35.738179 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2413a917-53f6-4863-b850-284a0f3ff9cd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:35.739955 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2413a917-53f6-4863-b850-284a0f3ff9cd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:35.865618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2413a917-53f6-4863-b850-284a0f3ff9cd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:35.875503 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2413a917-53f6-4863-b850-284a0f3ff9cd tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.149601 Aug 10 05:18:35.876077 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 255/501] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:35 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:36.004140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:36.005688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:36.012331 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:36.013058 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:36.019017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:36.019568 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:36.193306 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:36.223552 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:36.223552 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:36.223552 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b6c556b9-9942-4efe-9919-1c60bbd7e28c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1723 microversion: 2.20 time: 0.223331 Aug 10 05:18:36.224436 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 247/502] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:35 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:36.893104 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c85b8e20-9c1b-4463-aa7e-f85b65b6f368 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:36.894369 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c85b8e20-9c1b-4463-aa7e-f85b65b6f368 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:36.901333 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c85b8e20-9c1b-4463-aa7e-f85b65b6f368 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:36.902002 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c85b8e20-9c1b-4463-aa7e-f85b65b6f368 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:36.903267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c85b8e20-9c1b-4463-aa7e-f85b65b6f368 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:36.903873 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c85b8e20-9c1b-4463-aa7e-f85b65b6f368 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:37.245299 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:37.247297 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:37.256454 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:37.257285 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:37.258489 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:37.259166 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:37.357669 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c85b8e20-9c1b-4463-aa7e-f85b65b6f368 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:37.375928 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c85b8e20-9c1b-4463-aa7e-f85b65b6f368 tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1522 microversion: 2.1 time: 0.485881 Aug 10 05:18:37.377822 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 256/503] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:36 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:37.439274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:37.452140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:37.455101 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:37.458018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6ce003a9-7b3b-4fc0-828d-8af932dbc1b3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1726 microversion: 2.20 time: 0.220243 Aug 10 05:18:37.459782 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 248/504] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:37 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:37.477538 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-cd95185f-b487-439b-b6bc-6637f7313616 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e142673a-94b8-4ab6-9367-d02c4a539bb2"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:37.478902 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-cd95185f-b487-439b-b6bc-6637f7313616 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:37.485869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd95185f-b487-439b-b6bc-6637f7313616 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:37.486934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd95185f-b487-439b-b6bc-6637f7313616 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:37.487938 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd95185f-b487-439b-b6bc-6637f7313616 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:37.489263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd95185f-b487-439b-b6bc-6637f7313616 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:38.356726 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-4b756d9e-7137-4d58-8021-9ed1bf921092 req-caadafe0-390b-4556-af3f-d96a098bf0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "087a4339-30e4-48c7-aae6-024174e2d953", "name": "network-vif-deleted", "tag": "547c861b-680d-4e59-b838-09c136bb1bab"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:38.358542 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:18:38.358542 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:18:38.365917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-4b756d9e-7137-4d58-8021-9ed1bf921092 req-caadafe0-390b-4556-af3f-d96a098bf0dd service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:38.366362 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-4b756d9e-7137-4d58-8021-9ed1bf921092 req-caadafe0-390b-4556-af3f-d96a098bf0dd service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:38.378447 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-4b756d9e-7137-4d58-8021-9ed1bf921092 req-caadafe0-390b-4556-af3f-d96a098bf0dd service nova] Creating event network-vif-deleted:547c861b-680d-4e59-b838-09c136bb1bab for instance 087a4339-30e4-48c7-aae6-024174e2d953 on hv-cinder-80390 Aug 10 05:18:38.388646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-4b756d9e-7137-4d58-8021-9ed1bf921092 req-caadafe0-390b-4556-af3f-d96a098bf0dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035723 Aug 10 05:18:38.390379 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 249/505] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:18:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:18:38.398875 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-46281f48-753d-4ad1-a653-3577f57e6abb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:38.399774 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-46281f48-753d-4ad1-a653-3577f57e6abb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:38.419349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-46281f48-753d-4ad1-a653-3577f57e6abb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:38.420012 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-46281f48-753d-4ad1-a653-3577f57e6abb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:38.420917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-46281f48-753d-4ad1-a653-3577f57e6abb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:38.421457 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-46281f48-753d-4ad1-a653-3577f57e6abb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:38.540417 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-46281f48-753d-4ad1-a653-3577f57e6abb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a561148ea4c14d07a050ca8dc5787085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec44caf79c6e4d48a3d328a58919df19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:38.559011 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-46281f48-753d-4ad1-a653-3577f57e6abb tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 200 len: 1480 microversion: 2.1 time: 0.155716 Aug 10 05:18:38.559011 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 250/506] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:38 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 1480 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:18:38.747666 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-cd95185f-b487-439b-b6bc-6637f7313616 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.274703 Aug 10 05:18:38.748679 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 257/507] 10.222.0.16 () {62 vars in 1364 bytes} [Tue Aug 10 05:18:37 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments => generated 188 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:18:38.882117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-13707ee6-c427-47b1-8d65-82fca4dc5ad4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:38.882753 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-13707ee6-c427-47b1-8d65-82fca4dc5ad4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:38.888652 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-13707ee6-c427-47b1-8d65-82fca4dc5ad4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:38.889097 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-13707ee6-c427-47b1-8d65-82fca4dc5ad4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:38.889858 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-13707ee6-c427-47b1-8d65-82fca4dc5ad4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:38.890294 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-13707ee6-c427-47b1-8d65-82fca4dc5ad4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:39.094566 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ac35eb15-f1c4-4e1d-968b-cec499c2088c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Action: 'create', calling method: .version_select at 0x7fb33ce7e430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1485416630"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:18:39.122821 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-ac35eb15-f1c4-4e1d-968b-cec499c2088c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Getting quotas for project 0b0757c9f3474f1d8d45d02c87abef53. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:18:39.126693 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-ac35eb15-f1c4-4e1d-968b-cec499c2088c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Getting quotas for user 3378945fb3734bb395995268af72960d and project 0b0757c9f3474f1d8d45d02c87abef53. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:18:39.170920 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-13707ee6-c427-47b1-8d65-82fca4dc5ad4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action" status: 202 len: 0 microversion: 2.20 time: 0.292906 Aug 10 05:18:39.171568 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 251/508] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:18:38 2021] POST /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 05:18:39.179930 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:39.180763 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:39.190206 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:39.190206 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:39.190206 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:39.190206 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:39.339213 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:39.353184 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:39.356639 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:39.356639 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7741dd3d-3bfd-4031-819e-faf4306dda4a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1752 microversion: 2.20 time: 0.179896 Aug 10 05:18:39.356639 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 252/509] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:39 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:39.565119 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:39.565823 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] [instance: 087a4339-30e4-48c7-aae6-024174e2d953] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:39.571875 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:39.575494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:39.575494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:39.575494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:39.586671 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] HTTP exception thrown: Instance 087a4339-30e4-48c7-aae6-024174e2d953 could not be found. Aug 10 05:18:39.587259 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] Returning 404 to user: Instance 087a4339-30e4-48c7-aae6-024174e2d953 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:18:39.588080 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9d37ab16-7289-486f-9513-96a4380b8eac tempest-ServerRescueNegativeTestJSON-1031278551 tempest-ServerRescueNegativeTestJSON-1031278551-project] 10.222.0.16 "GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953" status: 404 len: 111 microversion: 2.1 time: 0.026771 Aug 10 05:18:39.588601 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 253/510] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:18:39 2021] GET /compute/v2.1/servers/087a4339-30e4-48c7-aae6-024174e2d953 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:18:39.703031 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-ac35eb15-f1c4-4e1d-968b-cec499c2088c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Getting quotas for project 0b0757c9f3474f1d8d45d02c87abef53. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:18:39.706704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-ac35eb15-f1c4-4e1d-968b-cec499c2088c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Getting quotas for user 3378945fb3734bb395995268af72960d and project 0b0757c9f3474f1d8d45d02c87abef53. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:18:39.720144 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ac35eb15-f1c4-4e1d-968b-cec499c2088c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.816638 Aug 10 05:18:39.720738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 258/511] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Aug 10 05:18:38 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:18:40.383591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:40.384208 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:40.402423 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:40.402946 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:40.403815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:40.405785 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:40.610244 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:40.621647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:40.623269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:40.624498 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f20db21a-7123-4aae-8cc2-e3fe1ec79852 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1752 microversion: 2.20 time: 0.253049 Aug 10 05:18:40.628274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 254/512] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:40 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1752 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:41.643477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:41.644100 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:41.655504 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:41.661250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:41.662282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:41.662957 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:42.082012 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:42.108436 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:42.111636 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:42.113137 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-cf0df982-26ef-4fc6-9d0f-c70600f9b746 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1754 microversion: 2.20 time: 0.473959 Aug 10 05:18:42.114157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 259/513] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:41 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1754 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:43.144823 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:43.144823 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:43.144823 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:43.144823 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:43.146159 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:43.146159 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:43.353103 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:43.361463 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:43.362985 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:43.364124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-17164b52-39ba-47cc-a751-e4c6d7c8f6ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.235515 Aug 10 05:18:43.364684 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 255/514] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:43 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:18:44.383461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:44.384088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:44.389907 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:44.392891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:44.392891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:44.392891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:44.523238 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:44.535526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:44.537668 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:44.538845 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3eccbb99-d928-452a-8c3c-9a10f2a725ed tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.159957 Aug 10 05:18:44.539399 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 260/515] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:44 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:45.556550 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:45.557193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:45.563089 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:45.563544 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:45.564312 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:45.564752 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:45.684408 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:45.692842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:45.694306 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:45.695452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-21be4be1-73ba-40b2-9fc3-94cc3e3de58a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.142827 Aug 10 05:18:45.696006 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 256/516] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:45 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:46.714557 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:46.720496 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:46.724148 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:46.724810 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:46.725874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:46.726316 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:46.895401 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:46.903698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:46.905386 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:46.906654 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f66749f4-b38c-4894-9338-e34f5e08f859 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.196758 Aug 10 05:18:46.907154 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 261/517] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:46 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:18:47.925145 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:47.925751 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:47.932361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:47.932817 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:47.934327 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:47.934808 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:48.093240 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:48.105935 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:48.108251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:48.109654 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7fb4e2ba-ec47-48be-8411-3d31d7295a46 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.188230 Aug 10 05:18:48.121917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 257/518] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:47 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:49.130844 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:49.131957 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:49.141233 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:49.141738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:49.142720 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:49.148681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:49.284681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:49.294542 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:49.296054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:49.297240 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c4d50f3b-1b34-4ce4-a115-d754eb29f872 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.171668 Aug 10 05:18:49.297737 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 262/519] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:49 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:50.316486 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:50.318642 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:50.324818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:50.325835 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:50.327035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:50.327802 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:50.479880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:50.496516 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:50.498440 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:50.499660 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3872f8ab-3138-4c08-a782-e89e294472e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.187463 Aug 10 05:18:50.502717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 258/520] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:50 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:51.541934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:51.541934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:51.541934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:51.541934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:51.542678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:51.542678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:51.695431 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:51.704144 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:51.705797 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:51.707047 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-197b318c-9f83-4cc7-869e-9480fd35a2ef tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.192793 Aug 10 05:18:51.715511 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 263/521] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:51 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:52.727104 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:52.727857 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:52.733643 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:52.734097 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:52.739829 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:52.740389 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:52.887361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:52.896286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:52.898857 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:52.899093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8495945d-b393-4a51-8f6d-40c50ba1cdff tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.176253 Aug 10 05:18:52.900145 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 259/522] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:52 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:53.917358 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:53.918147 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:53.925267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:53.925717 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:53.927228 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:53.927661 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:54.060683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:54.072834 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:54.074337 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:54.075731 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5d6202fd-5351-4550-9559-414e8255f5d0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.162047 Aug 10 05:18:54.086978 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 264/523] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:53 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:55.096147 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:55.100175 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:55.104184 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:55.105044 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:55.105535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:55.106149 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:55.298909 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:55.307280 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:55.308784 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:55.309913 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-122fa8fe-5bcb-4bb2-a686-46e76f308818 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.218799 Aug 10 05:18:55.310466 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 260/524] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:55 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:56.328388 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:56.329041 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:56.335978 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:56.337319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:56.337319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:56.337526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:56.491798 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:56.502111 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:56.505937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:56.505937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2c4b5684-100b-40b0-a5a0-0d240306793b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.180552 Aug 10 05:18:56.505937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 265/525] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:56 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:57.522904 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:57.523516 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:57.533209 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:57.533829 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:57.534805 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:57.535886 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:57.674284 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:57.683691 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:57.685205 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:57.686401 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fef9feee-e189-425b-a671-e06b51c278d7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.167261 Aug 10 05:18:57.686979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 261/526] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:57 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:58.705415 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:58.706136 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:58.713006 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:58.713555 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:58.714410 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:58.714874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:58.823667 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:18:58.824639 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:18:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:18:58.855281 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:58.879764 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:58.884417 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:18:58.886869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3fe5713e-76ad-4c47-81fc-c5791c1565e6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.185908 Aug 10 05:18:58.895288 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 266/527] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:58 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:18:59.909258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:18:59.910518 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:18:59.916574 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:59.917026 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:18:59.917801 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:18:59.918237 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:00.037936 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:00.046201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:00.047787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:00.048935 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4d66205c-44d9-4d11-8354-6cb280c09d04 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.143426 Aug 10 05:19:00.049487 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 262/528] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:18:59 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:01.066888 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:01.067490 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:01.073210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:01.073656 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:01.074411 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:01.074876 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:01.196757 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:01.205273 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:01.206792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:01.208276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-55ececfe-8757-4642-bebc-dd9a8d8a344b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.145879 Aug 10 05:19:01.208999 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 267/529] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:01 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:02.226736 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:02.227342 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:02.233196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:02.233583 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:02.234401 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:02.234866 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:02.359809 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:02.368981 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:02.370467 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:02.371631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4180196e-1a11-469b-92eb-8b1ba12373e3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.148677 Aug 10 05:19:02.372172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 263/530] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:02 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:03.391129 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:03.397136 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:03.397627 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:03.398084 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:03.398924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:03.399344 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:03.528072 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:03.538157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:03.539846 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:03.541078 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2802e9d8-af78-4041-b58c-cd7dbf4e76f8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.153934 Aug 10 05:19:03.552166 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 268/531] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:03 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:04.560717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:04.560717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:04.573867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:04.574337 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:04.575163 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:04.575601 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:04.698344 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:04.706610 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:04.708124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:04.709263 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-68de395c-c940-476c-bc83-b1639070b9fb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.153563 Aug 10 05:19:04.709818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 264/532] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:04 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:05.194871 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1418686775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1485416630", "security_groups": [{"name": "tempest-secgroup-smoke-200236987"}], "networks": [{"uuid": "8b920336-9528-4d28-9689-33047efe42d0"}], "block_device_mapping_v2": [{"uuid": "2eee24ff-63c7-403f-874a-bdf572613bac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:19:05.531094 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] validate_networks() for [('8b920336-9528-4d28-9689-33047efe42d0', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:19:05.728063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:05.728706 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:05.735016 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:05.735473 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:05.736304 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:05.736749 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:05.857731 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:05.865970 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:05.867653 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:05.869047 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-02702b06-cd88-4995-b2c8-17bbe8a045af tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.145227 Aug 10 05:19:05.869600 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 265/533] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:05 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:05.884176 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:19:05.884795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:19:05.885258 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:19:05.885664 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:19:05.886103 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:19:05.895915 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:05.896698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:05.897138 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:05.897567 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:05.913276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Getting quotas for project 0b0757c9f3474f1d8d45d02c87abef53. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:19:05.918526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Getting quotas for user 3378945fb3734bb395995268af72960d and project 0b0757c9f3474f1d8d45d02c87abef53. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:19:05.976013 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:19:05.978158 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2eee24ff-63c7-403f-874a-bdf572613bac',volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:19:06.485849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [3dffd844-190f-4e0f-ae58-9bcd091a8911] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 05:19:06.887761 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:06.888265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:06.894780 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:06.895237 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:06.896061 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:06.896503 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:07.020706 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:07.028917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:07.030418 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:07.031607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-eb391211-a18d-454a-9502-c07e8a4f13bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.147697 Aug 10 05:19:07.032174 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 266/534] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:06 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:07.506116 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [3dffd844-190f-4e0f-ae58-9bcd091a8911] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56688. Aug 10 05:19:07.510270 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d0ee795d-1eeb-478f-bd0a-093dbcd2ccd7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.319115 Aug 10 05:19:07.511241 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 269/535] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:19:05 2021] POST /compute/v2.1/servers => generated 405 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 05:19:07.526923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f298ef81-6688-4ae1-b265-e64f354beb85 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:07.535172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f298ef81-6688-4ae1-b265-e64f354beb85 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:07.588887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f298ef81-6688-4ae1-b265-e64f354beb85 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:07.595123 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f298ef81-6688-4ae1-b265-e64f354beb85 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1089 microversion: 2.1 time: 0.078278 Aug 10 05:19:07.596018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 267/536] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:07 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1089 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:19:08.050490 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:08.051181 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:08.057196 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:08.057650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:08.058432 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:08.058900 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:08.189252 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:08.197667 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:08.199210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:08.200346 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bcc7db4b-b703-456a-81b4-312f644a0051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.153666 Aug 10 05:19:08.201355 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 270/537] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:08 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:08.611985 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9fc3af61-0efe-4132-8d8a-9865af55956f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:08.612597 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9fc3af61-0efe-4132-8d8a-9865af55956f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:08.619815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fc3af61-0efe-4132-8d8a-9865af55956f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:08.620469 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fc3af61-0efe-4132-8d8a-9865af55956f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:08.621423 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fc3af61-0efe-4132-8d8a-9865af55956f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:08.622021 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9fc3af61-0efe-4132-8d8a-9865af55956f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:08.686658 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9fc3af61-0efe-4132-8d8a-9865af55956f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:08.694381 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9fc3af61-0efe-4132-8d8a-9865af55956f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1139 microversion: 2.1 time: 0.086189 Aug 10 05:19:08.696099 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 268/538] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:08 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:09.218788 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:09.219392 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:09.227253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:09.227835 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:09.228823 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:09.229495 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:09.369346 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:09.377648 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:09.379225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:09.380370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-fd1932ca-4e1e-479f-a2a7-c20963adc4b4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.165181 Aug 10 05:19:09.380928 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 271/539] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:09 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:09.512132 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-1a42bafc-a35d-41a7-bd3a-4e34919185f1 req-bb827024-e9bf-406e-85ff-023b22eef008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125a0f58-1cac-47b7-8486-e02530bcfb8f", "name": "network-vif-plugged", "status": "completed", "tag": "0e39f9de-97c4-4fa4-8a77-9dc21b2123a9"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:19:09.513923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:19:09.513923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:19:09.521428 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-1a42bafc-a35d-41a7-bd3a-4e34919185f1 req-bb827024-e9bf-406e-85ff-023b22eef008 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:09.522011 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-1a42bafc-a35d-41a7-bd3a-4e34919185f1 req-bb827024-e9bf-406e-85ff-023b22eef008 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:09.535880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-1a42bafc-a35d-41a7-bd3a-4e34919185f1 req-bb827024-e9bf-406e-85ff-023b22eef008 service nova] Creating event network-vif-plugged:0e39f9de-97c4-4fa4-8a77-9dc21b2123a9 for instance 125a0f58-1cac-47b7-8486-e02530bcfb8f on hv-cinder-80390 Aug 10 05:19:09.541006 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-1a42bafc-a35d-41a7-bd3a-4e34919185f1 req-bb827024-e9bf-406e-85ff-023b22eef008 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032650 Aug 10 05:19:09.541693 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 269/540] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:19:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:19:09.711660 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2a297323-fbde-4073-b1d6-8374028071e9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:09.712374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2a297323-fbde-4073-b1d6-8374028071e9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:09.718457 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2a297323-fbde-4073-b1d6-8374028071e9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:09.719019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2a297323-fbde-4073-b1d6-8374028071e9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:09.719846 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2a297323-fbde-4073-b1d6-8374028071e9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:09.720350 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2a297323-fbde-4073-b1d6-8374028071e9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:09.782844 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2a297323-fbde-4073-b1d6-8374028071e9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:09.794338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2a297323-fbde-4073-b1d6-8374028071e9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1187 microversion: 2.1 time: 0.085726 Aug 10 05:19:09.796752 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 272/541] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:09 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:10.399443 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:10.400239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:10.406403 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:10.406910 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:10.407826 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:10.408309 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:10.550016 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:10.560150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:10.562369 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:10.563869 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b9358ef5-2a50-4a30-ab77-7b12788db159 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.169230 Aug 10 05:19:10.567088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 270/542] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:10 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:10.815259 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bcfd97cc-5d73-431b-892c-5c96a4dac7e8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:10.815869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-bcfd97cc-5d73-431b-892c-5c96a4dac7e8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:10.823440 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bcfd97cc-5d73-431b-892c-5c96a4dac7e8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:10.824384 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bcfd97cc-5d73-431b-892c-5c96a4dac7e8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:10.825241 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bcfd97cc-5d73-431b-892c-5c96a4dac7e8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:10.825924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bcfd97cc-5d73-431b-892c-5c96a4dac7e8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:11.061497 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-bcfd97cc-5d73-431b-892c-5c96a4dac7e8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:11.069657 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bcfd97cc-5d73-431b-892c-5c96a4dac7e8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1272 microversion: 2.1 time: 0.257962 Aug 10 05:19:11.070241 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 273/543] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:10 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1272 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:11.582702 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:11.583880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:11.590156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:11.595384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:11.595384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:11.595384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:11.723927 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:11.732139 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:11.733639 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:11.734821 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3e5ba6b9-685f-473a-8409-5f4ef3126d5f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.155984 Aug 10 05:19:11.735378 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 271/544] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:11 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:12.088720 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8c0899b0-7140-435e-933c-ae6f6d081734 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:12.089328 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8c0899b0-7140-435e-933c-ae6f6d081734 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:12.095515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8c0899b0-7140-435e-933c-ae6f6d081734 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:12.095961 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8c0899b0-7140-435e-933c-ae6f6d081734 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:12.096736 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8c0899b0-7140-435e-933c-ae6f6d081734 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:12.097187 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8c0899b0-7140-435e-933c-ae6f6d081734 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:12.182550 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-996c2281-491f-4274-a5d9-794b1ccab731 req-1c45d625-c877-4d71-a1e7-068f3075edb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766cb709-769b-418b-ad7e-d2360a7f57e8", "tag": "c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:19:12.186757 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:19:12.186757 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:19:12.198266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-996c2281-491f-4274-a5d9-794b1ccab731 req-1c45d625-c877-4d71-a1e7-068f3075edb7 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:12.198266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-996c2281-491f-4274-a5d9-794b1ccab731 req-1c45d625-c877-4d71-a1e7-068f3075edb7 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:12.211491 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-996c2281-491f-4274-a5d9-794b1ccab731 req-1c45d625-c877-4d71-a1e7-068f3075edb7 service nova] Creating event network-changed:c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154 for instance 766cb709-769b-418b-ad7e-d2360a7f57e8 on hv-cinder-80390 Aug 10 05:19:12.216566 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-996c2281-491f-4274-a5d9-794b1ccab731 req-1c45d625-c877-4d71-a1e7-068f3075edb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040318 Aug 10 05:19:12.217434 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 272/545] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:19:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:19:12.339945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8c0899b0-7140-435e-933c-ae6f6d081734 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:12.374023 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8c0899b0-7140-435e-933c-ae6f6d081734 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.290924 Aug 10 05:19:12.374727 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 274/546] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:12 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:19:12.754704 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:12.756070 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:12.774842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:12.774842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:12.774842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:12.774842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:12.977511 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:12.984045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:12.985356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:12.986934 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4a8648c8-72e9-4d83-a919-57a0f8a7f338 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1810 microversion: 2.20 time: 0.237122 Aug 10 05:19:12.988281 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 273/547] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:12 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:13.391864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-51f9a4fe-4950-45af-89c5-fbc04a541046 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:13.392549 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-51f9a4fe-4950-45af-89c5-fbc04a541046 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:13.399065 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fe-4950-45af-89c5-fbc04a541046 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:13.399508 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fe-4950-45af-89c5-fbc04a541046 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:13.400267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fe-4950-45af-89c5-fbc04a541046 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:13.400698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-51f9a4fe-4950-45af-89c5-fbc04a541046 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:13.525392 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-51f9a4fe-4950-45af-89c5-fbc04a541046 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:13.537123 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-51f9a4fe-4950-45af-89c5-fbc04a541046 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.148849 Aug 10 05:19:13.537703 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 275/548] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:13 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:14.005137 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:14.005747 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:14.011943 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:14.012399 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:14.013174 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:14.013614 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:14.143261 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:14.151571 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:14.153059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:14.154215 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f8a379ca-32ed-4438-a550-d050569d0249 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1797 microversion: 2.20 time: 0.152947 Aug 10 05:19:14.154959 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 274/549] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:14 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1797 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:19:14.552955 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-21715df2-1bc6-4a47-87bd-88e7ac5de1e3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:14.553708 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-21715df2-1bc6-4a47-87bd-88e7ac5de1e3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:14.561422 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-21715df2-1bc6-4a47-87bd-88e7ac5de1e3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:14.561800 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-21715df2-1bc6-4a47-87bd-88e7ac5de1e3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:14.562600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-21715df2-1bc6-4a47-87bd-88e7ac5de1e3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:14.563040 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-21715df2-1bc6-4a47-87bd-88e7ac5de1e3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:14.684859 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-21715df2-1bc6-4a47-87bd-88e7ac5de1e3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:14.692827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-21715df2-1bc6-4a47-87bd-88e7ac5de1e3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.143498 Aug 10 05:19:14.693367 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 276/550] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:14 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:19:15.711556 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4ceb61d2-3298-47b3-8e95-9fc6511aeac3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:15.712164 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4ceb61d2-3298-47b3-8e95-9fc6511aeac3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:15.718153 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4ceb61d2-3298-47b3-8e95-9fc6511aeac3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:15.718646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4ceb61d2-3298-47b3-8e95-9fc6511aeac3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:15.719430 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4ceb61d2-3298-47b3-8e95-9fc6511aeac3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:15.719871 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4ceb61d2-3298-47b3-8e95-9fc6511aeac3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:15.841271 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4ceb61d2-3298-47b3-8e95-9fc6511aeac3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:15.849269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4ceb61d2-3298-47b3-8e95-9fc6511aeac3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.141392 Aug 10 05:19:15.849814 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 275/551] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:15 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:16.864922 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-275523ef-f40b-4059-8cac-581d012632df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:16.865536 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-275523ef-f40b-4059-8cac-581d012632df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:16.871866 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-275523ef-f40b-4059-8cac-581d012632df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:16.872311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-275523ef-f40b-4059-8cac-581d012632df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:16.873080 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-275523ef-f40b-4059-8cac-581d012632df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:16.873508 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-275523ef-f40b-4059-8cac-581d012632df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:16.989567 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-275523ef-f40b-4059-8cac-581d012632df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:16.997167 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-275523ef-f40b-4059-8cac-581d012632df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.135845 Aug 10 05:19:16.997724 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 277/552] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:16 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:18.014218 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a659019b-3e33-4dab-abb1-1e23fe206953 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:18.014854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a659019b-3e33-4dab-abb1-1e23fe206953 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:18.021194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a659019b-3e33-4dab-abb1-1e23fe206953 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:18.021647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a659019b-3e33-4dab-abb1-1e23fe206953 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:18.022440 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a659019b-3e33-4dab-abb1-1e23fe206953 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:18.022904 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a659019b-3e33-4dab-abb1-1e23fe206953 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:18.140126 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a659019b-3e33-4dab-abb1-1e23fe206953 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:18.147857 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a659019b-3e33-4dab-abb1-1e23fe206953 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.137394 Aug 10 05:19:18.148418 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 276/553] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:18 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:19.164550 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ab718439-5934-4eb6-9982-5aca6a8b9bac tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:19.165157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ab718439-5934-4eb6-9982-5aca6a8b9bac tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:19.174528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ab718439-5934-4eb6-9982-5aca6a8b9bac tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:19.174528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ab718439-5934-4eb6-9982-5aca6a8b9bac tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:19.174528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ab718439-5934-4eb6-9982-5aca6a8b9bac tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:19.174528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ab718439-5934-4eb6-9982-5aca6a8b9bac tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:19.289636 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ab718439-5934-4eb6-9982-5aca6a8b9bac tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:19.297252 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ab718439-5934-4eb6-9982-5aca6a8b9bac tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.136309 Aug 10 05:19:19.297786 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 278/554] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:19 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:20.312886 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-667b8215-fa81-46c0-a561-20d1ee3364f6 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:20.321122 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-667b8215-fa81-46c0-a561-20d1ee3364f6 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:20.321122 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-667b8215-fa81-46c0-a561-20d1ee3364f6 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:20.321122 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-667b8215-fa81-46c0-a561-20d1ee3364f6 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:20.321505 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-667b8215-fa81-46c0-a561-20d1ee3364f6 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:20.321793 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-667b8215-fa81-46c0-a561-20d1ee3364f6 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:20.479181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-667b8215-fa81-46c0-a561-20d1ee3364f6 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:20.486424 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-667b8215-fa81-46c0-a561-20d1ee3364f6 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.177198 Aug 10 05:19:20.487024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 277/555] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:20 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:21.505023 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1318417b-138a-49a3-8cd5-a0ba1559de8a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:21.505643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1318417b-138a-49a3-8cd5-a0ba1559de8a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:21.513332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1318417b-138a-49a3-8cd5-a0ba1559de8a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:21.514010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1318417b-138a-49a3-8cd5-a0ba1559de8a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:21.514813 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1318417b-138a-49a3-8cd5-a0ba1559de8a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:21.515286 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1318417b-138a-49a3-8cd5-a0ba1559de8a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:21.675645 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1318417b-138a-49a3-8cd5-a0ba1559de8a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:21.684067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1318417b-138a-49a3-8cd5-a0ba1559de8a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.183884 Aug 10 05:19:21.684638 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 279/556] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:21 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:22.639249 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1be7cf47-c3bb-49e6-8de5-712da9077270 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:22.639782 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1be7cf47-c3bb-49e6-8de5-712da9077270 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:22.645925 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1be7cf47-c3bb-49e6-8de5-712da9077270 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:22.646369 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1be7cf47-c3bb-49e6-8de5-712da9077270 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:22.647156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1be7cf47-c3bb-49e6-8de5-712da9077270 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:22.647592 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1be7cf47-c3bb-49e6-8de5-712da9077270 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:22.700974 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0c237c4d-27cb-49e7-bfa9-ce4ce4a97099 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:22.701582 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0c237c4d-27cb-49e7-bfa9-ce4ce4a97099 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:22.720121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c237c4d-27cb-49e7-bfa9-ce4ce4a97099 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:22.720651 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c237c4d-27cb-49e7-bfa9-ce4ce4a97099 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:22.721439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c237c4d-27cb-49e7-bfa9-ce4ce4a97099 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:22.721881 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c237c4d-27cb-49e7-bfa9-ce4ce4a97099 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:22.758721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-1be7cf47-c3bb-49e6-8de5-712da9077270 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lazy-loading 'services' on Instance uuid 272edeea-3a02-4556-8e12-3a5de760965d {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:19:22.847617 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0c237c4d-27cb-49e7-bfa9-ce4ce4a97099 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:22.855223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0c237c4d-27cb-49e7-bfa9-ce4ce4a97099 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.158028 Aug 10 05:19:22.864050 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 280/557] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:22 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:23.045035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1be7cf47-c3bb-49e6-8de5-712da9077270 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/os-volume_attachments/6883fb8c-f59c-41c2-b1b4-bd1a11c9c4b4" status: 202 len: 0 microversion: 2.1 time: 0.409275 Aug 10 05:19:23.048762 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 278/558] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:19:22 2021] DELETE /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/os-volume_attachments/6883fb8c-f59c-41c2-b1b4-bd1a11c9c4b4 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:19:23.872453 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a1d02641-151c-4408-a83e-fa266c5ac064 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:23.873070 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a1d02641-151c-4408-a83e-fa266c5ac064 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:23.878885 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a1d02641-151c-4408-a83e-fa266c5ac064 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:23.879335 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a1d02641-151c-4408-a83e-fa266c5ac064 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:23.880099 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a1d02641-151c-4408-a83e-fa266c5ac064 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:23.880534 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a1d02641-151c-4408-a83e-fa266c5ac064 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:24.012754 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a1d02641-151c-4408-a83e-fa266c5ac064 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:24.020720 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a1d02641-151c-4408-a83e-fa266c5ac064 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.152236 Aug 10 05:19:24.021290 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 281/559] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:23 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:24.163740 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c9d1d1df-a41c-473e-9887-be968bac994e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:19:24.169971 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9d1d1df-a41c-473e-9887-be968bac994e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:24.170419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9d1d1df-a41c-473e-9887-be968bac994e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:24.191779 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c9d1d1df-a41c-473e-9887-be968bac994e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Going to try to stop instance {{(pid=108137) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 10 05:19:24.386526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c9d1d1df-a41c-473e-9887-be968bac994e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 202 len: 0 microversion: 2.1 time: 0.227346 Aug 10 05:19:24.387172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 279/560] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:19:24 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:19:24.395699 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aadd5a48-f599-43bc-9156-f50625211694 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:24.396332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-aadd5a48-f599-43bc-9156-f50625211694 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:24.402262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aadd5a48-f599-43bc-9156-f50625211694 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:24.402794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aadd5a48-f599-43bc-9156-f50625211694 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:24.403525 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aadd5a48-f599-43bc-9156-f50625211694 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:24.403963 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aadd5a48-f599-43bc-9156-f50625211694 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:24.528973 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aadd5a48-f599-43bc-9156-f50625211694 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:24.539587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aadd5a48-f599-43bc-9156-f50625211694 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.148145 Aug 10 05:19:24.540196 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 282/561] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:24 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:25.038142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-dbebeccb-d779-425c-83a3-d764f14185df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:25.038985 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-dbebeccb-d779-425c-83a3-d764f14185df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:25.044950 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dbebeccb-d779-425c-83a3-d764f14185df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:25.045407 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dbebeccb-d779-425c-83a3-d764f14185df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:25.046233 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dbebeccb-d779-425c-83a3-d764f14185df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:25.046705 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dbebeccb-d779-425c-83a3-d764f14185df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:25.171169 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-dbebeccb-d779-425c-83a3-d764f14185df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:25.179076 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-dbebeccb-d779-425c-83a3-d764f14185df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.145585 Aug 10 05:19:25.179727 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 280/562] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:25 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:25.557157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aed0830b-4d1f-4427-80fc-2c32b0795f70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:25.557894 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-aed0830b-4d1f-4427-80fc-2c32b0795f70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:25.564015 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aed0830b-4d1f-4427-80fc-2c32b0795f70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:25.564456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aed0830b-4d1f-4427-80fc-2c32b0795f70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:25.565243 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aed0830b-4d1f-4427-80fc-2c32b0795f70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:25.565671 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aed0830b-4d1f-4427-80fc-2c32b0795f70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:25.652093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-eac0a303-2481-4a41-9dd1-bbe3be39c7aa req-d4c57cc5-f213-4237-b661-1cef2fb15aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766cb709-769b-418b-ad7e-d2360a7f57e8", "name": "network-vif-plugged", "status": "completed", "tag": "c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:19:25.654012 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:19:25.654012 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:19:25.665384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-eac0a303-2481-4a41-9dd1-bbe3be39c7aa req-d4c57cc5-f213-4237-b661-1cef2fb15aee service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:25.666012 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-eac0a303-2481-4a41-9dd1-bbe3be39c7aa req-d4c57cc5-f213-4237-b661-1cef2fb15aee service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:25.677550 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-eac0a303-2481-4a41-9dd1-bbe3be39c7aa req-d4c57cc5-f213-4237-b661-1cef2fb15aee service nova] Creating event network-vif-plugged:c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154 for instance 766cb709-769b-418b-ad7e-d2360a7f57e8 on hv-cinder-80390 Aug 10 05:19:25.682388 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-eac0a303-2481-4a41-9dd1-bbe3be39c7aa req-d4c57cc5-f213-4237-b661-1cef2fb15aee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036066 Aug 10 05:19:25.685867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 281/563] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:19:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:19:25.704701 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aed0830b-4d1f-4427-80fc-2c32b0795f70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:25.712971 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aed0830b-4d1f-4427-80fc-2c32b0795f70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.159590 Aug 10 05:19:25.713556 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 283/564] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:25 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:26.196500 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5475dfe6-ec89-4fa4-b070-8d5e7e845571 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:26.197226 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5475dfe6-ec89-4fa4-b070-8d5e7e845571 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:26.203261 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5475dfe6-ec89-4fa4-b070-8d5e7e845571 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:26.203712 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5475dfe6-ec89-4fa4-b070-8d5e7e845571 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:26.204484 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5475dfe6-ec89-4fa4-b070-8d5e7e845571 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:26.205042 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5475dfe6-ec89-4fa4-b070-8d5e7e845571 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:26.336878 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-5475dfe6-ec89-4fa4-b070-8d5e7e845571 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:26.344175 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5475dfe6-ec89-4fa4-b070-8d5e7e845571 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1260 microversion: 2.1 time: 0.151700 Aug 10 05:19:26.344883 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 282/565] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:26 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:26.730707 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4095a538-c6cf-490f-968b-cdb8152c35a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:26.731322 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4095a538-c6cf-490f-968b-cdb8152c35a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:26.737219 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4095a538-c6cf-490f-968b-cdb8152c35a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:26.737672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4095a538-c6cf-490f-968b-cdb8152c35a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:26.739240 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4095a538-c6cf-490f-968b-cdb8152c35a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:26.739945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4095a538-c6cf-490f-968b-cdb8152c35a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:26.870328 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4095a538-c6cf-490f-968b-cdb8152c35a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:26.878166 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4095a538-c6cf-490f-968b-cdb8152c35a9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.151197 Aug 10 05:19:26.878810 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 284/566] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:26 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:27.361133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d0bd2651-42e1-4791-a504-3da0635e041d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:27.361872 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d0bd2651-42e1-4791-a504-3da0635e041d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:27.368347 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d0bd2651-42e1-4791-a504-3da0635e041d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:27.370457 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d0bd2651-42e1-4791-a504-3da0635e041d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:27.370457 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d0bd2651-42e1-4791-a504-3da0635e041d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:27.370457 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d0bd2651-42e1-4791-a504-3da0635e041d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:27.509035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d0bd2651-42e1-4791-a504-3da0635e041d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:27.520185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d0bd2651-42e1-4791-a504-3da0635e041d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1445 microversion: 2.1 time: 0.159093 Aug 10 05:19:27.520185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 283/567] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:27 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1445 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:27.532717 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-42f4a9fb-a60d-4b30-a87e-15da49e8048d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:27.533421 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-42f4a9fb-a60d-4b30-a87e-15da49e8048d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:27.539689 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-42f4a9fb-a60d-4b30-a87e-15da49e8048d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:27.540164 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-42f4a9fb-a60d-4b30-a87e-15da49e8048d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:27.540929 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-42f4a9fb-a60d-4b30-a87e-15da49e8048d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:27.541371 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-42f4a9fb-a60d-4b30-a87e-15da49e8048d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:27.666028 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-42f4a9fb-a60d-4b30-a87e-15da49e8048d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:27.673482 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-42f4a9fb-a60d-4b30-a87e-15da49e8048d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1445 microversion: 2.1 time: 0.144510 Aug 10 05:19:27.674170 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 285/568] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:27 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1445 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:27.903024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cef65e16-e2bb-4387-8f22-a94f9898cc44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:27.906173 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cef65e16-e2bb-4387-8f22-a94f9898cc44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:27.919056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cef65e16-e2bb-4387-8f22-a94f9898cc44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:27.919629 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cef65e16-e2bb-4387-8f22-a94f9898cc44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:27.920647 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cef65e16-e2bb-4387-8f22-a94f9898cc44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:27.921309 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cef65e16-e2bb-4387-8f22-a94f9898cc44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:28.060029 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cef65e16-e2bb-4387-8f22-a94f9898cc44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:28.068274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cef65e16-e2bb-4387-8f22-a94f9898cc44 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.176581 Aug 10 05:19:28.069032 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 284/569] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:27 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:29.093119 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-98bd9330-fd7e-4657-bbeb-ed7dc80e34de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:29.095202 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-98bd9330-fd7e-4657-bbeb-ed7dc80e34de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:29.103368 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-98bd9330-fd7e-4657-bbeb-ed7dc80e34de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:29.103917 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-98bd9330-fd7e-4657-bbeb-ed7dc80e34de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:29.105588 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-98bd9330-fd7e-4657-bbeb-ed7dc80e34de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:29.106824 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-98bd9330-fd7e-4657-bbeb-ed7dc80e34de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:29.325637 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-98bd9330-fd7e-4657-bbeb-ed7dc80e34de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:29.333413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-98bd9330-fd7e-4657-bbeb-ed7dc80e34de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.248946 Aug 10 05:19:29.334025 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 286/570] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:29 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:19:30.350970 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cb077679-1fd9-4439-b93c-1a991f33f08f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:30.363603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cb077679-1fd9-4439-b93c-1a991f33f08f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:30.363603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb077679-1fd9-4439-b93c-1a991f33f08f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:30.363603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb077679-1fd9-4439-b93c-1a991f33f08f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:30.363603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb077679-1fd9-4439-b93c-1a991f33f08f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:30.364248 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb077679-1fd9-4439-b93c-1a991f33f08f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:30.367262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-4804b3ae-503a-4a2e-938a-4d8393fef40e req-12ad5ef1-574e-4e0a-bfde-a0ea76c06ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766cb709-769b-418b-ad7e-d2360a7f57e8", "tag": "c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:19:30.369615 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:19:30.369615 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:19:30.377922 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-4804b3ae-503a-4a2e-938a-4d8393fef40e req-12ad5ef1-574e-4e0a-bfde-a0ea76c06ceb service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:30.378391 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-4804b3ae-503a-4a2e-938a-4d8393fef40e req-12ad5ef1-574e-4e0a-bfde-a0ea76c06ceb service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:30.390464 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-4804b3ae-503a-4a2e-938a-4d8393fef40e req-12ad5ef1-574e-4e0a-bfde-a0ea76c06ceb service nova] Creating event network-changed:c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154 for instance 766cb709-769b-418b-ad7e-d2360a7f57e8 on hv-cinder-80390 Aug 10 05:19:30.403084 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-4804b3ae-503a-4a2e-938a-4d8393fef40e req-12ad5ef1-574e-4e0a-bfde-a0ea76c06ceb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037372 Aug 10 05:19:30.403084 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 287/571] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:19:30.519982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cb077679-1fd9-4439-b93c-1a991f33f08f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:30.528812 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cb077679-1fd9-4439-b93c-1a991f33f08f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.182213 Aug 10 05:19:30.530006 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 285/572] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:30 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:31.547440 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bad27425-1a23-4d6c-8d30-bdb834c50ce8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:31.548262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-bad27425-1a23-4d6c-8d30-bdb834c50ce8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:31.555253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bad27425-1a23-4d6c-8d30-bdb834c50ce8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:31.555744 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bad27425-1a23-4d6c-8d30-bdb834c50ce8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:31.556482 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bad27425-1a23-4d6c-8d30-bdb834c50ce8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:31.556934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bad27425-1a23-4d6c-8d30-bdb834c50ce8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:31.690131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-bad27425-1a23-4d6c-8d30-bdb834c50ce8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:31.699044 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bad27425-1a23-4d6c-8d30-bdb834c50ce8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.155686 Aug 10 05:19:31.699601 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 288/573] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:31 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:32.715628 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9e707ae1-79b7-4814-867b-4d9ed5d25c2a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:32.716216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9e707ae1-79b7-4814-867b-4d9ed5d25c2a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:32.722703 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9e707ae1-79b7-4814-867b-4d9ed5d25c2a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:32.723153 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9e707ae1-79b7-4814-867b-4d9ed5d25c2a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:32.724018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9e707ae1-79b7-4814-867b-4d9ed5d25c2a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:32.724448 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9e707ae1-79b7-4814-867b-4d9ed5d25c2a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:32.860583 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9e707ae1-79b7-4814-867b-4d9ed5d25c2a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:32.868804 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9e707ae1-79b7-4814-867b-4d9ed5d25c2a tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.156903 Aug 10 05:19:32.869420 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 286/574] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:32 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:33.885403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a6457525-75f9-487f-8c10-2ceda1f25c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:33.886570 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a6457525-75f9-487f-8c10-2ceda1f25c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:33.892637 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a6457525-75f9-487f-8c10-2ceda1f25c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:33.893098 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a6457525-75f9-487f-8c10-2ceda1f25c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:33.893934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a6457525-75f9-487f-8c10-2ceda1f25c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:33.894374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a6457525-75f9-487f-8c10-2ceda1f25c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:34.019761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a6457525-75f9-487f-8c10-2ceda1f25c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:34.027107 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a6457525-75f9-487f-8c10-2ceda1f25c70 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1675 microversion: 2.1 time: 0.145288 Aug 10 05:19:34.027605 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 289/575] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:33 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:35.044392 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d60c6508-77d5-420e-86a5-5713c478ccdd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:35.044999 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d60c6508-77d5-420e-86a5-5713c478ccdd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:35.050789 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d60c6508-77d5-420e-86a5-5713c478ccdd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:35.051246 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d60c6508-77d5-420e-86a5-5713c478ccdd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:35.052013 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d60c6508-77d5-420e-86a5-5713c478ccdd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:35.052451 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d60c6508-77d5-420e-86a5-5713c478ccdd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:35.175787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d60c6508-77d5-420e-86a5-5713c478ccdd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:35.184337 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d60c6508-77d5-420e-86a5-5713c478ccdd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1652 microversion: 2.1 time: 0.143507 Aug 10 05:19:35.184908 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 287/576] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:35 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1652 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:35.209178 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4b6c9a41-fff5-49bd-aa58-302501b5ee88 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:19:35.215225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4b6c9a41-fff5-49bd-aa58-302501b5ee88 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:35.215682 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4b6c9a41-fff5-49bd-aa58-302501b5ee88 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:35.275397 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4b6c9a41-fff5-49bd-aa58-302501b5ee88 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Going to try to start instance {{(pid=108136) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 10 05:19:35.448732 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4b6c9a41-fff5-49bd-aa58-302501b5ee88 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action" status: 202 len: 0 microversion: 2.1 time: 0.242962 Aug 10 05:19:35.449250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 290/577] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:19:35 2021] POST /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:19:35.457094 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-72b125bf-36b0-45b0-8225-3eb61f267f5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:35.458059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-72b125bf-36b0-45b0-8225-3eb61f267f5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:35.463973 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-72b125bf-36b0-45b0-8225-3eb61f267f5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:35.464420 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-72b125bf-36b0-45b0-8225-3eb61f267f5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:35.465213 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-72b125bf-36b0-45b0-8225-3eb61f267f5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:35.465641 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-72b125bf-36b0-45b0-8225-3eb61f267f5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:35.595059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-72b125bf-36b0-45b0-8225-3eb61f267f5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:35.602891 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-72b125bf-36b0-45b0-8225-3eb61f267f5d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1661 microversion: 2.1 time: 0.149380 Aug 10 05:19:35.603451 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 288/578] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:35 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:36.620716 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d94efd28-0488-4369-866e-c338b07206b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:36.621539 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d94efd28-0488-4369-866e-c338b07206b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:36.627592 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d94efd28-0488-4369-866e-c338b07206b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:36.628126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d94efd28-0488-4369-866e-c338b07206b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:36.629005 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d94efd28-0488-4369-866e-c338b07206b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:36.629503 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d94efd28-0488-4369-866e-c338b07206b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:36.753890 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d94efd28-0488-4369-866e-c338b07206b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:36.761507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d94efd28-0488-4369-866e-c338b07206b5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1661 microversion: 2.1 time: 0.145118 Aug 10 05:19:36.762105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 291/579] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:36 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1661 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:37.778419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-228e5467-44bd-458b-af4f-a142ce988c02 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:37.779046 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-228e5467-44bd-458b-af4f-a142ce988c02 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:37.784804 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-228e5467-44bd-458b-af4f-a142ce988c02 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:37.785247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-228e5467-44bd-458b-af4f-a142ce988c02 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:37.786498 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-228e5467-44bd-458b-af4f-a142ce988c02 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:37.786949 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-228e5467-44bd-458b-af4f-a142ce988c02 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:37.910092 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-228e5467-44bd-458b-af4f-a142ce988c02 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:37.918103 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-228e5467-44bd-458b-af4f-a142ce988c02 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1665 microversion: 2.1 time: 0.143384 Aug 10 05:19:37.918682 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 289/580] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:19:37 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1665 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:53.834814 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e2bdc713-bcfa-4c55-8f21-697cb04a1804 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:53.835358 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e2bdc713-bcfa-4c55-8f21-697cb04a1804 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:53.841375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e2bdc713-bcfa-4c55-8f21-697cb04a1804 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:53.841827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e2bdc713-bcfa-4c55-8f21-697cb04a1804 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:53.842612 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e2bdc713-bcfa-4c55-8f21-697cb04a1804 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:53.843059 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e2bdc713-bcfa-4c55-8f21-697cb04a1804 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:53.872269 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e2bdc713-bcfa-4c55-8f21-697cb04a1804 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments/e142673a-94b8-4ab6-9367-d02c4a539bb2" status: 200 len: 194 microversion: 2.20 time: 0.041344 Aug 10 05:19:53.872853 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 292/581] 10.222.0.16 () {60 vars in 1454 bytes} [Tue Aug 10 05:19:53 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments/e142673a-94b8-4ab6-9367-d02c4a539bb2 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:19:53.937679 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-85f6981e-c4b5-477b-bab8-e616922ddf33 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:53.938193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-85f6981e-c4b5-477b-bab8-e616922ddf33 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:53.944767 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-85f6981e-c4b5-477b-bab8-e616922ddf33 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:53.945181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-85f6981e-c4b5-477b-bab8-e616922ddf33 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:53.945957 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-85f6981e-c4b5-477b-bab8-e616922ddf33 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:53.946401 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-85f6981e-c4b5-477b-bab8-e616922ddf33 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:54.027832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-85f6981e-c4b5-477b-bab8-e616922ddf33 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lazy-loading 'services' on Instance uuid 125a0f58-1cac-47b7-8486-e02530bcfb8f {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:19:54.211711 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-85f6981e-c4b5-477b-bab8-e616922ddf33 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments/e142673a-94b8-4ab6-9367-d02c4a539bb2" status: 202 len: 0 microversion: 2.20 time: 0.277780 Aug 10 05:19:54.212297 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 290/582] 10.222.0.16 () {60 vars in 1457 bytes} [Tue Aug 10 05:19:53 2021] DELETE /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments/e142673a-94b8-4ab6-9367-d02c4a539bb2 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:19:54.220460 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7c330083-df2b-4ed2-9733-202a8cf17923 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:54.221390 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7c330083-df2b-4ed2-9733-202a8cf17923 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:54.227931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c330083-df2b-4ed2-9733-202a8cf17923 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:54.228385 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c330083-df2b-4ed2-9733-202a8cf17923 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:54.229225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c330083-df2b-4ed2-9733-202a8cf17923 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:54.229664 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c330083-df2b-4ed2-9733-202a8cf17923 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:54.261559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7c330083-df2b-4ed2-9733-202a8cf17923 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044883 Aug 10 05:19:54.262122 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 293/583] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Aug 10 05:19:54 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:19:55.274282 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-268d381c-100d-4673-8304-3b5ef7c3d909 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:55.275441 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-268d381c-100d-4673-8304-3b5ef7c3d909 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:55.281449 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-268d381c-100d-4673-8304-3b5ef7c3d909 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:55.287367 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-268d381c-100d-4673-8304-3b5ef7c3d909 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:55.287367 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-268d381c-100d-4673-8304-3b5ef7c3d909 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:55.287367 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-268d381c-100d-4673-8304-3b5ef7c3d909 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:55.311910 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-268d381c-100d-4673-8304-3b5ef7c3d909 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042698 Aug 10 05:19:55.312462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 291/584] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Aug 10 05:19:55 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:19:56.323940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9e21bf48-a34d-4471-ac6e-b31fa34cb3d6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:56.324842 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9e21bf48-a34d-4471-ac6e-b31fa34cb3d6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:56.330725 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9e21bf48-a34d-4471-ac6e-b31fa34cb3d6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:56.331173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9e21bf48-a34d-4471-ac6e-b31fa34cb3d6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:56.331939 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9e21bf48-a34d-4471-ac6e-b31fa34cb3d6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:56.332368 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9e21bf48-a34d-4471-ac6e-b31fa34cb3d6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:56.360779 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9e21bf48-a34d-4471-ac6e-b31fa34cb3d6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040616 Aug 10 05:19:56.361328 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 294/585] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Aug 10 05:19:56 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:19:56.419794 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f0d3c213-8dbe-4ff5-8793-58f3b73b389d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:56.420321 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f0d3c213-8dbe-4ff5-8793-58f3b73b389d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:56.425937 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f0d3c213-8dbe-4ff5-8793-58f3b73b389d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:56.426387 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f0d3c213-8dbe-4ff5-8793-58f3b73b389d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:56.427196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f0d3c213-8dbe-4ff5-8793-58f3b73b389d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:56.427631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f0d3c213-8dbe-4ff5-8793-58f3b73b389d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:56.451456 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f0d3c213-8dbe-4ff5-8793-58f3b73b389d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Going to try to terminate instance {{(pid=108137) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:19:56.710199 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f0d3c213-8dbe-4ff5-8793-58f3b73b389d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 204 len: 0 microversion: 2.20 time: 0.293744 Aug 10 05:19:56.710815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 292/586] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Aug 10 05:19:56 2021] DELETE /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 05:19:56.718652 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:56.722526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:56.725143 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:56.725595 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:56.726357 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:56.726838 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:56.847748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:56.855357 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:56.856840 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:56.857963 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c6888556-3d5c-40b9-b1dd-ec44029fb7ea tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.142989 Aug 10 05:19:56.858519 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 295/587] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:56 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:57.877475 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:57.878198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:57.884737 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:57.885182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:57.885932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:57.886362 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:58.004940 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:58.012724 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:58.014259 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:58.015423 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4590bfdd-9f01-455e-bd56-d63e3b76ff9d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.142122 Aug 10 05:19:58.015979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 293/588] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:57 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:59.033463 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:19:59.034061 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:19:59.039948 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:59.040396 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:59.041249 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:59.041684 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:59.496993 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:59.504823 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:59.506368 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:19:59.507526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-18b3e644-8c29-4c62-85d7-6730bbf55114 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1725 microversion: 2.20 time: 0.477798 Aug 10 05:19:59.518019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 296/589] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:19:59 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1725 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:19:59.681754 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-6a5b4941-76d2-462c-9584-730136121016 req-a4705baf-626a-4651-be1c-f21d67797157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125a0f58-1cac-47b7-8486-e02530bcfb8f", "name": "network-vif-deleted", "tag": "0e39f9de-97c4-4fa4-8a77-9dc21b2123a9"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:19:59.683338 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:19:59.683338 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:19:59.690182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-6a5b4941-76d2-462c-9584-730136121016 req-a4705baf-626a-4651-be1c-f21d67797157 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:19:59.693118 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-6a5b4941-76d2-462c-9584-730136121016 req-a4705baf-626a-4651-be1c-f21d67797157 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:19:59.701825 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-6a5b4941-76d2-462c-9584-730136121016 req-a4705baf-626a-4651-be1c-f21d67797157 service nova] Creating event network-vif-deleted:0e39f9de-97c4-4fa4-8a77-9dc21b2123a9 for instance 125a0f58-1cac-47b7-8486-e02530bcfb8f on hv-cinder-80390 Aug 10 05:19:59.706656 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-6a5b4941-76d2-462c-9584-730136121016 req-a4705baf-626a-4651-be1c-f21d67797157 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028488 Aug 10 05:19:59.707424 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 294/590] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:19:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:20:00.531297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:00.531297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:00.537479 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:00.538092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:00.538910 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:00.539340 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:00.580765 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:00.581469 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:00.581918 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lazy-loading 'fault' on Instance uuid 125a0f58-1cac-47b7-8486-e02530bcfb8f {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:20:00.625222 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:00.635532 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:00.637332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:00.638462 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-76c0b811-7897-4d9d-9828-46a95a8e2126 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 200 len: 1372 microversion: 2.20 time: 0.114826 Aug 10 05:20:00.647001 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 297/591] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:00 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:01.659796 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:01.660553 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:01.667334 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:01.667784 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:01.668550 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:01.668989 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:01.681643 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] HTTP exception thrown: Instance 125a0f58-1cac-47b7-8486-e02530bcfb8f could not be found. Aug 10 05:20:01.682220 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Returning 404 to user: Instance 125a0f58-1cac-47b7-8486-e02530bcfb8f could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:20:01.683063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-83937299-f024-4030-b31b-3aec552b258b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 404 len: 111 microversion: 2.20 time: 0.027339 Aug 10 05:20:01.683565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 295/592] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:01 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 05:20:01.691516 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d111deca-f844-4004-9af9-e0bf5958624b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '.version_select at 0x7fb33c4c7b80>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:01.784487 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d111deca-f844-4004-9af9-e0bf5958624b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890370678" status: 204 len: 0 microversion: 2.20 time: 0.096473 Aug 10 05:20:01.785000 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 298/593] 10.222.0.16 () {60 vars in 1262 bytes} [Tue Aug 10 05:20:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890370678 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 05:20:02.524577 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c6b68d0c-da25-4b17-8cac-018ed76200a7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'create', calling method: .version_select at 0x7fb33c52d550>, body: {"keypair": {"name": "tempest-keypair-1259055978"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:02.541984 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-c6b68d0c-da25-4b17-8cac-018ed76200a7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:20:02.545702 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-c6b68d0c-da25-4b17-8cac-018ed76200a7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for user af5ad45d471648a487e5c95cb63163e8 and project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:20:02.856459 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-c6b68d0c-da25-4b17-8cac-018ed76200a7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:20:02.860035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-c6b68d0c-da25-4b17-8cac-018ed76200a7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for user af5ad45d471648a487e5c95cb63163e8 and project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:20:02.874371 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c6b68d0c-da25-4b17-8cac-018ed76200a7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.353514 Aug 10 05:20:02.875047 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 296/594] 10.222.0.16 () {62 vars in 1199 bytes} [Tue Aug 10 05:20:02 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 355 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 10 05:20:05.078123 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-535483424", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e7136196-3303-4185-b6f3-4307c2ed7cf9"}], "security_groups": [{"name": "tempest-securitygroup--1549597054"}], "key_name": "tempest-keypair-1259055978", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:05.167291 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] validate_networks() for [('e7136196-3303-4185-b6f3-4307c2ed7cf9', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:20:05.517044 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:20:05.517501 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:20:05.517976 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:20:05.518387 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:20:05.518828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:20:05.527757 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:05.528204 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:05.528997 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:05.529428 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:05.545576 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:20:05.549462 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Getting quotas for user af5ad45d471648a487e5c95cb63163e8 and project 1bebe35ab6ed44b49537caff8aaa8562. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:20:05.560529 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:20:05.562834 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:20:05.704405 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0673a681-582f-47d0-9dc5-bf5552604773 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.630356 Aug 10 05:20:05.704972 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 299/595] 10.222.0.16 () {62 vars in 1188 bytes} [Tue Aug 10 05:20:05 2021] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 05:20:05.714568 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-62aab0ca-fef9-47ca-9a83-a927bc15f269 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:05.715201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-62aab0ca-fef9-47ca-9a83-a927bc15f269 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:05.771673 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-62aab0ca-fef9-47ca-9a83-a927bc15f269 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:05.779559 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-62aab0ca-fef9-47ca-9a83-a927bc15f269 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:05.781083 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-62aab0ca-fef9-47ca-9a83-a927bc15f269 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:05.782204 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-62aab0ca-fef9-47ca-9a83-a927bc15f269 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1281 microversion: 2.20 time: 0.071288 Aug 10 05:20:05.782780 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 297/596] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:05 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:06.800514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:06.801537 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:06.807920 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:06.808363 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:06.809121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:06.809552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:06.871435 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:06.880703 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:06.882190 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:06.883946 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ff589d67-2fb6-477d-865e-0cfa090558d8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1277 microversion: 2.20 time: 0.087404 Aug 10 05:20:06.884693 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 300/597] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:06 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:07.901688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:07.902415 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:07.908193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:07.908757 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:07.909536 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:07.909979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:07.976503 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:07.984106 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:07.985602 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:07.986705 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c9723207-6bd6-4680-9e51-9def1ac88fe7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1339 microversion: 2.20 time: 0.088700 Aug 10 05:20:07.987270 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 298/598] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:07 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:09.005211 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:09.005925 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:09.013295 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:09.013753 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:09.014733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:09.015180 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:09.032574 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-a457cb7d-ba92-45e7-8b23-c83b9e6e19de req-f6664257-4d6c-416f-b663-08c9439ab9ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef", "tag": "e218a600-deee-4780-bff5-a3a5af129359"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:09.034251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:20:09.034251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:20:09.042841 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-a457cb7d-ba92-45e7-8b23-c83b9e6e19de req-f6664257-4d6c-416f-b663-08c9439ab9ae service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:09.043712 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-a457cb7d-ba92-45e7-8b23-c83b9e6e19de req-f6664257-4d6c-416f-b663-08c9439ab9ae service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:09.057564 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-a457cb7d-ba92-45e7-8b23-c83b9e6e19de req-f6664257-4d6c-416f-b663-08c9439ab9ae service nova] Creating event network-changed:e218a600-deee-4780-bff5-a3a5af129359 for instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef on hv-cinder-80390 Aug 10 05:20:09.065689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-a457cb7d-ba92-45e7-8b23-c83b9e6e19de req-f6664257-4d6c-416f-b663-08c9439ab9ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036292 Aug 10 05:20:09.065689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 299/599] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:20:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:20:09.237308 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:09.245421 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:09.247013 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:09.248085 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f03c816b-a72d-469f-badd-d5013f47009d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1407 microversion: 2.20 time: 0.246793 Aug 10 05:20:09.248970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 301/600] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:09 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:10.266709 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:10.267404 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:10.273969 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:10.274426 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:10.275227 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:10.275666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:10.396751 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:10.404275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:10.405754 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:10.406844 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e870c066-855b-4cab-9f01-5314ad3a5a6c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1407 microversion: 2.20 time: 0.144211 Aug 10 05:20:10.407390 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 300/601] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:10 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:11.425530 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:11.426786 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:11.429168 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2458c05e-063b-49f5-ab8b-be20473e7346] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 05:20:11.433568 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:11.434019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:11.434819 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:11.435255 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:11.552701 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:11.560428 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:11.561929 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:11.563058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c0438535-767b-43d9-813f-0ed0218ef051 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1407 microversion: 2.20 time: 0.141342 Aug 10 05:20:11.563616 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 302/602] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:11 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1407 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:12.580450 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:12.581061 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:12.587283 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:12.587738 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:12.588508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:12.588950 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:12.703530 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:12.711121 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:12.712680 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:12.713787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-69a9285f-c33f-44e1-ac03-ae35414c5af0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1407 microversion: 2.20 time: 0.137114 Aug 10 05:20:12.714371 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 301/603] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:12 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:13.731402 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:13.732036 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:13.748340 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:13.748784 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:13.749554 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:13.749983 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:13.769294 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] [2458c05e-063b-49f5-ab8b-be20473e7346] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57690. Aug 10 05:20:13.874448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:13.882795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:13.884302 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:13.885420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2fe7ced6-b925-46d1-8699-ff7de172a150 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1407 microversion: 2.20 time: 0.157725 Aug 10 05:20:13.885983 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 303/604] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:13 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:14.903289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:14.903833 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:14.906301 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 05:20:14.910856 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:14.911314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:14.912083 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:14.912526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:15.031186 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:15.038931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:15.040437 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:15.041531 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f61a97eb-ac42-42cb-8a18-bd31ce999c54 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1407 microversion: 2.20 time: 0.142053 Aug 10 05:20:15.042089 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 302/605] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:14 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:15.948937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-494885b9-2f52-4716-a683-b3a80b0dc724 req-b3695592-3fa0-4b69-9074-40ca3679214b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef", "name": "network-vif-plugged", "status": "completed", "tag": "e218a600-deee-4780-bff5-a3a5af129359"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:15.950521 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:20:15.950521 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:20:15.958272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-494885b9-2f52-4716-a683-b3a80b0dc724 req-b3695592-3fa0-4b69-9074-40ca3679214b service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:15.958752 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-494885b9-2f52-4716-a683-b3a80b0dc724 req-b3695592-3fa0-4b69-9074-40ca3679214b service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:15.970109 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-494885b9-2f52-4716-a683-b3a80b0dc724 req-b3695592-3fa0-4b69-9074-40ca3679214b service nova] Creating event network-vif-plugged:e218a600-deee-4780-bff5-a3a5af129359 for instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef on hv-cinder-80390 Aug 10 05:20:15.975100 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-494885b9-2f52-4716-a683-b3a80b0dc724 req-b3695592-3fa0-4b69-9074-40ca3679214b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029839 Aug 10 05:20:15.975665 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 304/606] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:20:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:20:16.059656 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:16.060343 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:16.080981 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57704. Aug 10 05:20:16.085584 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:16.086031 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:16.086828 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:16.087275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:16.204587 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:16.214728 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:16.216279 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:16.217868 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7fd6cf77-8860-499c-8dec-65bcf4492e34 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1407 microversion: 2.20 time: 0.161848 Aug 10 05:20:16.218621 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 303/607] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:16 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:16.302725 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9866cfcf-6a7b-47ce-8e78-899a7b1cb85b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:16.303730 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9866cfcf-6a7b-47ce-8e78-899a7b1cb85b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:16.311258 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9866cfcf-6a7b-47ce-8e78-899a7b1cb85b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:16.311947 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9866cfcf-6a7b-47ce-8e78-899a7b1cb85b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:16.312896 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9866cfcf-6a7b-47ce-8e78-899a7b1cb85b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:16.313459 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9866cfcf-6a7b-47ce-8e78-899a7b1cb85b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:16.343538 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9866cfcf-6a7b-47ce-8e78-899a7b1cb85b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045514 Aug 10 05:20:16.344093 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 305/608] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:20:16 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:20:16.404251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c7b4d232-917f-4cbc-b55d-8a282f555fbc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:16.404747 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c7b4d232-917f-4cbc-b55d-8a282f555fbc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:16.410358 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c7b4d232-917f-4cbc-b55d-8a282f555fbc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:16.410840 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c7b4d232-917f-4cbc-b55d-8a282f555fbc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:16.411602 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c7b4d232-917f-4cbc-b55d-8a282f555fbc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:16.412033 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c7b4d232-917f-4cbc-b55d-8a282f555fbc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:16.436466 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c7b4d232-917f-4cbc-b55d-8a282f555fbc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Going to try to terminate instance {{(pid=108137) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:20:16.687926 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c7b4d232-917f-4cbc-b55d-8a282f555fbc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 204 len: 0 microversion: 2.1 time: 0.286872 Aug 10 05:20:16.688435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 304/609] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:20:16 2021] DELETE /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:20:16.699468 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-699baf3f-cf12-473a-bfb3-f5efc65c4353 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:16.700080 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-699baf3f-cf12-473a-bfb3-f5efc65c4353 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:16.705852 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-699baf3f-cf12-473a-bfb3-f5efc65c4353 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:16.706303 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-699baf3f-cf12-473a-bfb3-f5efc65c4353 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:16.707699 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-699baf3f-cf12-473a-bfb3-f5efc65c4353 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:16.708136 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-699baf3f-cf12-473a-bfb3-f5efc65c4353 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:16.824052 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-699baf3f-cf12-473a-bfb3-f5efc65c4353 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:16.831195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-699baf3f-cf12-473a-bfb3-f5efc65c4353 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1671 microversion: 2.1 time: 0.135395 Aug 10 05:20:16.832381 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 306/610] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:16 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1671 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:17.235661 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:17.236358 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:17.243127 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:17.243612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:17.244356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:17.244797 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:17.364214 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:17.372251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:17.373745 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:17.374854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cb87b202-e299-4b07-ae3e-afb89b5c2af6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1407 microversion: 2.20 time: 0.143334 Aug 10 05:20:17.375414 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 305/611] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:17 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:17.849294 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-15fd38dc-7254-4b16-b90f-fff1f71b1145 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:17.849842 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-15fd38dc-7254-4b16-b90f-fff1f71b1145 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:17.855741 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15fd38dc-7254-4b16-b90f-fff1f71b1145 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:17.856194 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15fd38dc-7254-4b16-b90f-fff1f71b1145 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:17.856952 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15fd38dc-7254-4b16-b90f-fff1f71b1145 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:17.857386 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15fd38dc-7254-4b16-b90f-fff1f71b1145 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:17.974920 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-15fd38dc-7254-4b16-b90f-fff1f71b1145 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:17.982151 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-15fd38dc-7254-4b16-b90f-fff1f71b1145 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1671 microversion: 2.1 time: 0.137250 Aug 10 05:20:17.982729 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 307/612] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:17 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1671 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:18.393060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:18.393675 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:18.400370 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:18.400832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:18.401603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:18.402045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:18.522246 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:18.528869 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:18.530344 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:18.531494 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0d406130-63b7-457e-8285-3fc348ff46b5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1599 microversion: 2.20 time: 0.142156 Aug 10 05:20:18.532045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 306/613] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:20:18 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1599 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:18.549194 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-de71b645-63ae-4381-8c4d-fbf664833afa tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:18.549689 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-de71b645-63ae-4381-8c4d-fbf664833afa tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:18.555961 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-de71b645-63ae-4381-8c4d-fbf664833afa tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:18.556417 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-de71b645-63ae-4381-8c4d-fbf664833afa tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:18.557189 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-de71b645-63ae-4381-8c4d-fbf664833afa tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:18.557630 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-de71b645-63ae-4381-8c4d-fbf664833afa tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:18.637336 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-de71b645-63ae-4381-8c4d-fbf664833afa tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091743 Aug 10 05:20:18.637930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 308/614] 10.222.0.16 () {60 vars in 1316 bytes} [Tue Aug 10 05:20:18 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:20:18.999087 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f7cfd3ab-6309-41eb-a868-b206c5967f46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:18.999857 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f7cfd3ab-6309-41eb-a868-b206c5967f46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:19.005689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f7cfd3ab-6309-41eb-a868-b206c5967f46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:19.006416 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f7cfd3ab-6309-41eb-a868-b206c5967f46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:19.007233 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f7cfd3ab-6309-41eb-a868-b206c5967f46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:19.007683 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f7cfd3ab-6309-41eb-a868-b206c5967f46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:19.133283 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f7cfd3ab-6309-41eb-a868-b206c5967f46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:19.140795 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f7cfd3ab-6309-41eb-a868-b206c5967f46 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1671 microversion: 2.1 time: 0.145312 Aug 10 05:20:19.141450 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 307/615] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:18 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1671 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:20.164882 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-54640a00-7593-4f87-9873-569a21a4a009 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:20.166127 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-54640a00-7593-4f87-9873-569a21a4a009 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:20.172122 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-54640a00-7593-4f87-9873-569a21a4a009 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:20.172770 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-54640a00-7593-4f87-9873-569a21a4a009 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:20.173565 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-54640a00-7593-4f87-9873-569a21a4a009 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:20.174000 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-54640a00-7593-4f87-9873-569a21a4a009 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:20.261795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-54640a00-7593-4f87-9873-569a21a4a009 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:20.269278 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-54640a00-7593-4f87-9873-569a21a4a009 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1604 microversion: 2.1 time: 0.108076 Aug 10 05:20:20.270104 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 309/616] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:20 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:20.324286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-25abde96-7428-479f-bd49-1c6f445c5c1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:20.325873 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-25abde96-7428-479f-bd49-1c6f445c5c1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:20.327773 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-13254a5b-9ad6-4b8a-a6e5-94f0b01920c3 req-aa163cbc-d408-4b2a-9870-1f3fad882183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef", "tag": "e218a600-deee-4780-bff5-a3a5af129359"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:20.329536 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:20:20.329536 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:20:20.335898 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25abde96-7428-479f-bd49-1c6f445c5c1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:20.337022 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25abde96-7428-479f-bd49-1c6f445c5c1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:20.338370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-13254a5b-9ad6-4b8a-a6e5-94f0b01920c3 req-aa163cbc-d408-4b2a-9870-1f3fad882183 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:20.338630 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25abde96-7428-479f-bd49-1c6f445c5c1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:20.339052 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-13254a5b-9ad6-4b8a-a6e5-94f0b01920c3 req-aa163cbc-d408-4b2a-9870-1f3fad882183 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:20.339791 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25abde96-7428-479f-bd49-1c6f445c5c1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:20.353101 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-13254a5b-9ad6-4b8a-a6e5-94f0b01920c3 req-aa163cbc-d408-4b2a-9870-1f3fad882183 service nova] Creating event network-changed:e218a600-deee-4780-bff5-a3a5af129359 for instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef on hv-cinder-80390 Aug 10 05:20:20.357860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-13254a5b-9ad6-4b8a-a6e5-94f0b01920c3 req-aa163cbc-d408-4b2a-9870-1f3fad882183 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033253 Aug 10 05:20:20.357860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 310/617] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:20:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:20:20.414221 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-25abde96-7428-479f-bd49-1c6f445c5c1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.093841 Aug 10 05:20:20.417528 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 308/618] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:20 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:21.286849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:21.287626 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:21.293687 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:21.294222 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:21.295094 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:21.295589 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:21.330704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:21.330704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:21.330704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lazy-loading 'fault' on Instance uuid 272edeea-3a02-4556-8e12-3a5de760965d {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:20:21.381938 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:21.390090 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ad862600-b691-4b6f-aa17-a89467deba11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 200 len: 1326 microversion: 2.1 time: 0.107358 Aug 10 05:20:21.390891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 311/619] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:21 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 1326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:21.426404 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bfbedf63-fd27-4467-a651-4eb466de240f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:21.427512 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bfbedf63-fd27-4467-a651-4eb466de240f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:21.435265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bfbedf63-fd27-4467-a651-4eb466de240f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:21.435724 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bfbedf63-fd27-4467-a651-4eb466de240f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:21.436518 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bfbedf63-fd27-4467-a651-4eb466de240f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:21.436963 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bfbedf63-fd27-4467-a651-4eb466de240f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:21.498082 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bfbedf63-fd27-4467-a651-4eb466de240f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.076394 Aug 10 05:20:21.501565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 309/620] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:21 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:22.404199 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-6f8fdc3e-cc2b-4061-8a10-75c9e7a45289 req-520a7ac5-b338-44b2-a59e-4144315d85a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272edeea-3a02-4556-8e12-3a5de760965d", "name": "network-vif-deleted", "tag": "b219101f-21b5-44e7-a715-56a50ee9d61a"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:22.405724 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:20:22.405724 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:20:22.407356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:22.408065 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:22.413158 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-6f8fdc3e-cc2b-4061-8a10-75c9e7a45289 req-520a7ac5-b338-44b2-a59e-4144315d85a3 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:22.413597 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-6f8fdc3e-cc2b-4061-8a10-75c9e7a45289 req-520a7ac5-b338-44b2-a59e-4144315d85a3 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:22.415064 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:22.415517 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:22.416290 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:22.416730 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:22.423866 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-6f8fdc3e-cc2b-4061-8a10-75c9e7a45289 req-520a7ac5-b338-44b2-a59e-4144315d85a3 service nova] Creating event network-vif-deleted:b219101f-21b5-44e7-a715-56a50ee9d61a for instance 272edeea-3a02-4556-8e12-3a5de760965d on hv-cinder-80390 Aug 10 05:20:22.428781 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-6f8fdc3e-cc2b-4061-8a10-75c9e7a45289 req-520a7ac5-b338-44b2-a59e-4144315d85a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028185 Aug 10 05:20:22.429551 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 312/621] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:20:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:20:22.429758 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] HTTP exception thrown: Instance 272edeea-3a02-4556-8e12-3a5de760965d could not be found. Aug 10 05:20:22.430335 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Returning 404 to user: Instance 272edeea-3a02-4556-8e12-3a5de760965d could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:20:22.431243 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-be4463cf-f886-43c4-bdfd-cc1adf35b167 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 404 len: 111 microversion: 2.1 time: 0.027875 Aug 10 05:20:22.431734 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 310/622] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:22 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:20:22.440070 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bda33dc2-160d-4b4f-8619-a1fd495b4d43 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '.version_select at 0x7fb33c4c70d0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:22.508623 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-11c36f39-afd7-4d8e-9b86-f65e979cbd47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:22.509605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-11c36f39-afd7-4d8e-9b86-f65e979cbd47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:22.515295 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-11c36f39-afd7-4d8e-9b86-f65e979cbd47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:22.515745 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-11c36f39-afd7-4d8e-9b86-f65e979cbd47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:22.516504 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-11c36f39-afd7-4d8e-9b86-f65e979cbd47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:22.516937 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-11c36f39-afd7-4d8e-9b86-f65e979cbd47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:22.524951 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bda33dc2-160d-4b4f-8619-a1fd495b4d43 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172929078" status: 202 len: 0 microversion: 2.1 time: 0.088647 Aug 10 05:20:22.525535 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 313/623] 10.222.0.16 () {58 vars in 1218 bytes} [Tue Aug 10 05:20:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172929078 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:20:22.585196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-11c36f39-afd7-4d8e-9b86-f65e979cbd47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.080086 Aug 10 05:20:22.585856 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 311/624] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:22 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:20:23.298215 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ef7feefa-79bc-447a-ac3a-d78b85b4f32b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'create', calling method: .version_select at 0x7fb33cd9e280>, body: {"keypair": {"name": "tempest-keypair-1346428465"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:23.316725 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-ef7feefa-79bc-447a-ac3a-d78b85b4f32b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:20:23.320542 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-ef7feefa-79bc-447a-ac3a-d78b85b4f32b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for user 490a8522f743475187844c39a4ba6dea and project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:20:23.515966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-ef7feefa-79bc-447a-ac3a-d78b85b4f32b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:20:23.520203 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-ef7feefa-79bc-447a-ac3a-d78b85b4f32b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for user 490a8522f743475187844c39a4ba6dea and project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:20:23.533408 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ef7feefa-79bc-447a-ac3a-d78b85b4f32b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.238899 Aug 10 05:20:23.533989 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 314/625] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Aug 10 05:20:23 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:23.595508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3ce8cfaa-94f7-4e93-b657-612d242ee8e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:23.596484 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3ce8cfaa-94f7-4e93-b657-612d242ee8e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:23.602813 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3ce8cfaa-94f7-4e93-b657-612d242ee8e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:23.603334 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3ce8cfaa-94f7-4e93-b657-612d242ee8e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:23.604095 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3ce8cfaa-94f7-4e93-b657-612d242ee8e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:23.604526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3ce8cfaa-94f7-4e93-b657-612d242ee8e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:23.665059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3ce8cfaa-94f7-4e93-b657-612d242ee8e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.073255 Aug 10 05:20:23.668258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 312/626] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:23 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:20:24.675828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-540d826a-1dab-4aa7-9fbc-4f4c27627e88 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:24.676864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-540d826a-1dab-4aa7-9fbc-4f4c27627e88 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:24.683256 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-540d826a-1dab-4aa7-9fbc-4f4c27627e88 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:24.683750 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-540d826a-1dab-4aa7-9fbc-4f4c27627e88 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:24.684564 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-540d826a-1dab-4aa7-9fbc-4f4c27627e88 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:24.685006 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-540d826a-1dab-4aa7-9fbc-4f4c27627e88 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:24.744261 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-540d826a-1dab-4aa7-9fbc-4f4c27627e88 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.072590 Aug 10 05:20:24.744875 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 315/627] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:24 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:25.698243 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1373059537", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5888986-d0a6-413e-a11d-31e19ef566b9"}], "security_groups": [{"name": "tempest-securitygroup--215460640"}], "key_name": "tempest-keypair-1346428465", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:25.755853 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-db3a99e5-980b-48ec-9e83-3a446c78b13f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:25.756854 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-db3a99e5-980b-48ec-9e83-3a446c78b13f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:25.763365 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-db3a99e5-980b-48ec-9e83-3a446c78b13f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:25.763815 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-db3a99e5-980b-48ec-9e83-3a446c78b13f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:25.764588 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-db3a99e5-980b-48ec-9e83-3a446c78b13f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:25.765021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-db3a99e5-980b-48ec-9e83-3a446c78b13f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:25.788347 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] validate_networks() for [('e5888986-d0a6-413e-a11d-31e19ef566b9', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:20:25.823802 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-db3a99e5-980b-48ec-9e83-3a446c78b13f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.072334 Aug 10 05:20:25.826904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 316/628] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:25 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:20:26.140248 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:20:26.140671 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:20:26.141136 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:20:26.141571 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:20:26.141976 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:20:26.150406 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:26.150880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:26.151673 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:26.152133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:26.167604 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:20:26.171406 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Getting quotas for user 490a8522f743475187844c39a4ba6dea and project 72a3bb25c2374aa8a148b26d66d2eda1. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:20:26.182460 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:20:26.184887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:20:26.386349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2867e8b2-4526-4f2e-8fa3-dbcff85399e9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.692548 Aug 10 05:20:26.387014 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 313/629] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:20:25 2021] POST /compute/v2.1/servers => generated 401 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:20:26.397267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-76b2e3a1-500f-4b90-978a-8f4f53040a37 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:26.401565 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-76b2e3a1-500f-4b90-978a-8f4f53040a37 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:26.450617 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-76b2e3a1-500f-4b90-978a-8f4f53040a37 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:26.457049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-76b2e3a1-500f-4b90-978a-8f4f53040a37 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1238 microversion: 2.1 time: 0.063847 Aug 10 05:20:26.457614 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 317/630] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:26 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:20:26.834614 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e1c9ed20-ee7c-483b-b488-d0756c12ee97 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:26.835629 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e1c9ed20-ee7c-483b-b488-d0756c12ee97 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:26.841766 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e1c9ed20-ee7c-483b-b488-d0756c12ee97 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:26.842214 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e1c9ed20-ee7c-483b-b488-d0756c12ee97 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:26.843002 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e1c9ed20-ee7c-483b-b488-d0756c12ee97 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:26.843435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e1c9ed20-ee7c-483b-b488-d0756c12ee97 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:26.912522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e1c9ed20-ee7c-483b-b488-d0756c12ee97 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.082469 Aug 10 05:20:26.913304 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 314/631] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:26 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:27.473441 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8b7b8130-1f08-4ee2-a723-53ca73a064ef tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:27.474051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8b7b8130-1f08-4ee2-a723-53ca73a064ef tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:27.481312 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8b7b8130-1f08-4ee2-a723-53ca73a064ef tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:27.481759 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8b7b8130-1f08-4ee2-a723-53ca73a064ef tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:27.482523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8b7b8130-1f08-4ee2-a723-53ca73a064ef tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:27.482989 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8b7b8130-1f08-4ee2-a723-53ca73a064ef tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:27.542070 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8b7b8130-1f08-4ee2-a723-53ca73a064ef tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:27.549272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8b7b8130-1f08-4ee2-a723-53ca73a064ef tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1242 microversion: 2.1 time: 0.079490 Aug 10 05:20:27.550611 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 318/632] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:27 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:27.923991 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-611ca7ce-ee13-4be9-b8ec-6fb1cb07556c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:27.925509 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-611ca7ce-ee13-4be9-b8ec-6fb1cb07556c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:27.932005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-611ca7ce-ee13-4be9-b8ec-6fb1cb07556c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:27.932449 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-611ca7ce-ee13-4be9-b8ec-6fb1cb07556c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:27.933207 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-611ca7ce-ee13-4be9-b8ec-6fb1cb07556c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:27.933638 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-611ca7ce-ee13-4be9-b8ec-6fb1cb07556c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:27.993325 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-611ca7ce-ee13-4be9-b8ec-6fb1cb07556c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.073268 Aug 10 05:20:27.993958 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 315/633] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:27 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:28.566274 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f8ad65f1-5994-4f3f-b7ee-75f4fedccf9f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:28.566987 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f8ad65f1-5994-4f3f-b7ee-75f4fedccf9f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:28.573223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8ad65f1-5994-4f3f-b7ee-75f4fedccf9f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:28.573684 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8ad65f1-5994-4f3f-b7ee-75f4fedccf9f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:28.574467 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8ad65f1-5994-4f3f-b7ee-75f4fedccf9f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:28.575062 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8ad65f1-5994-4f3f-b7ee-75f4fedccf9f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:28.637105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f8ad65f1-5994-4f3f-b7ee-75f4fedccf9f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:28.644430 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f8ad65f1-5994-4f3f-b7ee-75f4fedccf9f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1308 microversion: 2.1 time: 0.082451 Aug 10 05:20:28.645019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 319/634] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:28 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1308 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:29.005080 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-61f188ab-85a4-4ac4-b6b3-60b4563be8bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:29.006075 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-61f188ab-85a4-4ac4-b6b3-60b4563be8bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:29.012496 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-61f188ab-85a4-4ac4-b6b3-60b4563be8bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:29.015986 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-61f188ab-85a4-4ac4-b6b3-60b4563be8bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:29.015986 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-61f188ab-85a4-4ac4-b6b3-60b4563be8bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:29.015986 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-61f188ab-85a4-4ac4-b6b3-60b4563be8bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:29.073962 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-61f188ab-85a4-4ac4-b6b3-60b4563be8bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 14 microversion: 2.20 time: 0.073289 Aug 10 05:20:29.077084 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 316/635] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:28 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:29.666394 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a350f927-bbdb-4c1d-aaa9-cfe03cd1086c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:29.667035 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a350f927-bbdb-4c1d-aaa9-cfe03cd1086c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:29.673672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a350f927-bbdb-4c1d-aaa9-cfe03cd1086c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:29.674126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a350f927-bbdb-4c1d-aaa9-cfe03cd1086c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:29.675549 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a350f927-bbdb-4c1d-aaa9-cfe03cd1086c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:29.675984 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a350f927-bbdb-4c1d-aaa9-cfe03cd1086c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:29.801224 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a350f927-bbdb-4c1d-aaa9-cfe03cd1086c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:29.808491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a350f927-bbdb-4c1d-aaa9-cfe03cd1086c tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1363 microversion: 2.1 time: 0.145782 Aug 10 05:20:29.809064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 320/636] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:29 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:30.085021 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a1c0a85b-3d7f-4f30-852d-dd1110ee2210 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:30.086010 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a1c0a85b-3d7f-4f30-852d-dd1110ee2210 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:30.092364 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a1c0a85b-3d7f-4f30-852d-dd1110ee2210 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:30.092809 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a1c0a85b-3d7f-4f30-852d-dd1110ee2210 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:30.093572 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a1c0a85b-3d7f-4f30-852d-dd1110ee2210 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:30.094014 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a1c0a85b-3d7f-4f30-852d-dd1110ee2210 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:30.154177 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a1c0a85b-3d7f-4f30-852d-dd1110ee2210 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 8267 microversion: 2.20 time: 0.072965 Aug 10 05:20:30.157847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 317/637] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:30 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 8267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:20:30.170792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-6740e472-875b-48ce-903e-5cf26c333e5f req-bf1d4e56-d3ca-408c-83bb-e832f3310640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fbeaf1-6c57-45ec-9054-7bd64957f75b", "tag": "0f753a7a-5b22-4d1c-9dde-b5c1e567b981"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:30.172327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:20:30.172327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:20:30.188888 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-6740e472-875b-48ce-903e-5cf26c333e5f req-bf1d4e56-d3ca-408c-83bb-e832f3310640 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:30.190347 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-6740e472-875b-48ce-903e-5cf26c333e5f req-bf1d4e56-d3ca-408c-83bb-e832f3310640 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:30.203199 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-6740e472-875b-48ce-903e-5cf26c333e5f req-bf1d4e56-d3ca-408c-83bb-e832f3310640 service nova] Creating event network-changed:0f753a7a-5b22-4d1c-9dde-b5c1e567b981 for instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b on hv-cinder-80390 Aug 10 05:20:30.208602 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-6740e472-875b-48ce-903e-5cf26c333e5f req-bf1d4e56-d3ca-408c-83bb-e832f3310640 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041826 Aug 10 05:20:30.215518 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 321/638] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:20:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:20:30.825994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a53f1b5b-3122-4fdd-ba35-57c977a6a16f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:30.826743 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a53f1b5b-3122-4fdd-ba35-57c977a6a16f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:30.833713 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a53f1b5b-3122-4fdd-ba35-57c977a6a16f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:30.834165 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a53f1b5b-3122-4fdd-ba35-57c977a6a16f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:30.835032 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a53f1b5b-3122-4fdd-ba35-57c977a6a16f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:30.835475 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a53f1b5b-3122-4fdd-ba35-57c977a6a16f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:31.108176 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a53f1b5b-3122-4fdd-ba35-57c977a6a16f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:31.115579 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a53f1b5b-3122-4fdd-ba35-57c977a6a16f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1363 microversion: 2.1 time: 0.293677 Aug 10 05:20:31.116171 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 318/639] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:30 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:31.165140 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-baa3099a-4d78-49e1-8c67-93b1e1b83099 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:31.166056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-baa3099a-4d78-49e1-8c67-93b1e1b83099 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:31.171966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-baa3099a-4d78-49e1-8c67-93b1e1b83099 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:31.172411 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-baa3099a-4d78-49e1-8c67-93b1e1b83099 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:31.173161 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-baa3099a-4d78-49e1-8c67-93b1e1b83099 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:31.173591 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-baa3099a-4d78-49e1-8c67-93b1e1b83099 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:31.234890 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-baa3099a-4d78-49e1-8c67-93b1e1b83099 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 15258 microversion: 2.20 time: 0.073644 Aug 10 05:20:31.235530 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 322/640] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:31 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 15258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:32.132552 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fae79072-1674-42dc-9e06-9aa93d3ae84d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:32.133161 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fae79072-1674-42dc-9e06-9aa93d3ae84d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:32.139490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fae79072-1674-42dc-9e06-9aa93d3ae84d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:32.139932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fae79072-1674-42dc-9e06-9aa93d3ae84d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:32.140687 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fae79072-1674-42dc-9e06-9aa93d3ae84d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:32.141120 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fae79072-1674-42dc-9e06-9aa93d3ae84d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:32.246302 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a228bfc4-8a42-4c93-9c3c-f25d9ab88716 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:32.247372 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a228bfc4-8a42-4c93-9c3c-f25d9ab88716 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:32.254620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a228bfc4-8a42-4c93-9c3c-f25d9ab88716 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:32.260887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a228bfc4-8a42-4c93-9c3c-f25d9ab88716 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:32.260887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a228bfc4-8a42-4c93-9c3c-f25d9ab88716 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:32.260887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a228bfc4-8a42-4c93-9c3c-f25d9ab88716 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:32.263390 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-fae79072-1674-42dc-9e06-9aa93d3ae84d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:32.270548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fae79072-1674-42dc-9e06-9aa93d3ae84d tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1363 microversion: 2.1 time: 0.141723 Aug 10 05:20:32.271132 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 319/641] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:32 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:32.329443 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a228bfc4-8a42-4c93-9c3c-f25d9ab88716 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 18305 microversion: 2.20 time: 0.087193 Aug 10 05:20:32.330091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 323/642] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:32 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 18305 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:33.287799 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-36c53072-e83c-4d75-91df-58f592be12e0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:33.288404 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-36c53072-e83c-4d75-91df-58f592be12e0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:33.294296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-36c53072-e83c-4d75-91df-58f592be12e0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:33.294777 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-36c53072-e83c-4d75-91df-58f592be12e0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:33.295533 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-36c53072-e83c-4d75-91df-58f592be12e0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:33.295966 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-36c53072-e83c-4d75-91df-58f592be12e0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:33.341144 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b5c7469a-be3b-46be-9cc6-1a9b8b8de842 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:33.342183 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b5c7469a-be3b-46be-9cc6-1a9b8b8de842 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:33.349440 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b5c7469a-be3b-46be-9cc6-1a9b8b8de842 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:33.349908 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b5c7469a-be3b-46be-9cc6-1a9b8b8de842 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:33.350708 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b5c7469a-be3b-46be-9cc6-1a9b8b8de842 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:33.351147 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b5c7469a-be3b-46be-9cc6-1a9b8b8de842 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:33.412843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-36c53072-e83c-4d75-91df-58f592be12e0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:33.414189 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b5c7469a-be3b-46be-9cc6-1a9b8b8de842 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 19342 microversion: 2.20 time: 0.076954 Aug 10 05:20:33.414864 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 324/643] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:33 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 19342 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:20:33.420082 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-36c53072-e83c-4d75-91df-58f592be12e0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1363 microversion: 2.1 time: 0.136544 Aug 10 05:20:33.420633 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 320/644] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:33 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1363 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:34.426125 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-71a5c6dc-7209-4ecc-9ca6-8001c0689b19 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:34.427069 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-71a5c6dc-7209-4ecc-9ca6-8001c0689b19 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:34.433484 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71a5c6dc-7209-4ecc-9ca6-8001c0689b19 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:34.433935 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71a5c6dc-7209-4ecc-9ca6-8001c0689b19 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:34.434735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71a5c6dc-7209-4ecc-9ca6-8001c0689b19 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:34.435168 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-71a5c6dc-7209-4ecc-9ca6-8001c0689b19 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:34.436850 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8d1f635e-1a91-4d68-be4f-5e28bc409663 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:34.437469 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8d1f635e-1a91-4d68-be4f-5e28bc409663 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:34.444003 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8d1f635e-1a91-4d68-be4f-5e28bc409663 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:34.444459 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8d1f635e-1a91-4d68-be4f-5e28bc409663 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:34.445241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8d1f635e-1a91-4d68-be4f-5e28bc409663 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:34.445679 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8d1f635e-1a91-4d68-be4f-5e28bc409663 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:34.498600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-71a5c6dc-7209-4ecc-9ca6-8001c0689b19 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 22070 microversion: 2.20 time: 0.076427 Aug 10 05:20:34.499477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 325/645] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:34 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 22070 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:34.565394 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8d1f635e-1a91-4d68-be4f-5e28bc409663 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:34.572511 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8d1f635e-1a91-4d68-be4f-5e28bc409663 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1363 microversion: 2.1 time: 0.139281 Aug 10 05:20:34.573063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 321/646] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:34 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:20:35.510668 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6f8c29d7-eb47-4d28-99cf-57e98aef298d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:35.511666 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6f8c29d7-eb47-4d28-99cf-57e98aef298d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:35.518738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f8c29d7-eb47-4d28-99cf-57e98aef298d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:35.519192 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f8c29d7-eb47-4d28-99cf-57e98aef298d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:35.519963 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f8c29d7-eb47-4d28-99cf-57e98aef298d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:35.520460 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6f8c29d7-eb47-4d28-99cf-57e98aef298d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:35.585748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6f8c29d7-eb47-4d28-99cf-57e98aef298d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 23441 microversion: 2.20 time: 0.079051 Aug 10 05:20:35.586552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 326/647] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:35 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 23441 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:35.589251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-50c97d5b-a7b9-45e9-98ef-a35341c4582f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:35.589872 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-50c97d5b-a7b9-45e9-98ef-a35341c4582f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:35.595886 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50c97d5b-a7b9-45e9-98ef-a35341c4582f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:35.596339 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50c97d5b-a7b9-45e9-98ef-a35341c4582f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:35.597108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50c97d5b-a7b9-45e9-98ef-a35341c4582f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:35.597553 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50c97d5b-a7b9-45e9-98ef-a35341c4582f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:35.717246 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-50c97d5b-a7b9-45e9-98ef-a35341c4582f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:35.724387 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-50c97d5b-a7b9-45e9-98ef-a35341c4582f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1363 microversion: 2.1 time: 0.138767 Aug 10 05:20:35.724955 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 322/648] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:35 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:20:36.056079 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-812486c3-0919-483c-88fa-270d5ca86e71 req-7344325e-aad9-4e31-801d-b0ed66ec6fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fbeaf1-6c57-45ec-9054-7bd64957f75b", "name": "network-vif-plugged", "status": "completed", "tag": "0f753a7a-5b22-4d1c-9dde-b5c1e567b981"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:36.057558 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:20:36.057558 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:20:36.065031 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-812486c3-0919-483c-88fa-270d5ca86e71 req-7344325e-aad9-4e31-801d-b0ed66ec6fda service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:36.065477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-812486c3-0919-483c-88fa-270d5ca86e71 req-7344325e-aad9-4e31-801d-b0ed66ec6fda service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:36.077387 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-812486c3-0919-483c-88fa-270d5ca86e71 req-7344325e-aad9-4e31-801d-b0ed66ec6fda service nova] Creating event network-vif-plugged:0f753a7a-5b22-4d1c-9dde-b5c1e567b981 for instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b on hv-cinder-80390 Aug 10 05:20:36.082209 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-812486c3-0919-483c-88fa-270d5ca86e71 req-7344325e-aad9-4e31-801d-b0ed66ec6fda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030160 Aug 10 05:20:36.082869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 327/649] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:20:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:20:36.596520 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f711afcc-87b6-4fd3-88f7-b47818b15de5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:36.597490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f711afcc-87b6-4fd3-88f7-b47818b15de5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:36.603436 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f711afcc-87b6-4fd3-88f7-b47818b15de5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:36.603890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f711afcc-87b6-4fd3-88f7-b47818b15de5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:36.604661 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f711afcc-87b6-4fd3-88f7-b47818b15de5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:36.605132 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f711afcc-87b6-4fd3-88f7-b47818b15de5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:36.669680 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f711afcc-87b6-4fd3-88f7-b47818b15de5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 24950 microversion: 2.20 time: 0.076871 Aug 10 05:20:36.670197 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 323/650] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:36 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 24950 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:36.741842 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f617c567-7e92-4359-9252-fb3fbd998749 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:36.742539 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f617c567-7e92-4359-9252-fb3fbd998749 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:36.748618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f617c567-7e92-4359-9252-fb3fbd998749 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:36.749068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f617c567-7e92-4359-9252-fb3fbd998749 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:36.749828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f617c567-7e92-4359-9252-fb3fbd998749 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:36.750263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f617c567-7e92-4359-9252-fb3fbd998749 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:36.931886 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f617c567-7e92-4359-9252-fb3fbd998749 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:36.939087 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f617c567-7e92-4359-9252-fb3fbd998749 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1363 microversion: 2.1 time: 0.201449 Aug 10 05:20:36.939649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 328/651] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:36 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:37.681605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bc85c2f6-7940-49da-b121-94d8e0b61a47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:37.682664 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bc85c2f6-7940-49da-b121-94d8e0b61a47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:37.689032 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bc85c2f6-7940-49da-b121-94d8e0b61a47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:37.689977 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bc85c2f6-7940-49da-b121-94d8e0b61a47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:37.690820 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bc85c2f6-7940-49da-b121-94d8e0b61a47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:37.691259 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bc85c2f6-7940-49da-b121-94d8e0b61a47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:37.758177 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bc85c2f6-7940-49da-b121-94d8e0b61a47 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 26259 microversion: 2.20 time: 0.080508 Aug 10 05:20:37.758827 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 324/652] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:37 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 26259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:37.956249 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-93b81592-7594-4dc4-ab43-b21aff075939 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:37.956784 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-93b81592-7594-4dc4-ab43-b21aff075939 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:37.962974 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-93b81592-7594-4dc4-ab43-b21aff075939 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:37.963424 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-93b81592-7594-4dc4-ab43-b21aff075939 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:37.964427 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-93b81592-7594-4dc4-ab43-b21aff075939 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:37.964599 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-93b81592-7594-4dc4-ab43-b21aff075939 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:38.082305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-93b81592-7594-4dc4-ab43-b21aff075939 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:20:38.089428 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-93b81592-7594-4dc4-ab43-b21aff075939 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1550 microversion: 2.1 time: 0.137602 Aug 10 05:20:38.090185 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 329/653] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:20:37 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1550 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:38.105604 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7c058224-d6a5-4bb8-bb97-03eda87b08ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:38.106214 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7c058224-d6a5-4bb8-bb97-03eda87b08ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:38.113095 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7c058224-d6a5-4bb8-bb97-03eda87b08ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:38.113548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7c058224-d6a5-4bb8-bb97-03eda87b08ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:38.114610 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7c058224-d6a5-4bb8-bb97-03eda87b08ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:38.115048 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7c058224-d6a5-4bb8-bb97-03eda87b08ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:38.195978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7c058224-d6a5-4bb8-bb97-03eda87b08ee tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094388 Aug 10 05:20:38.196577 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 325/654] 10.222.0.16 () {58 vars in 1275 bytes} [Tue Aug 10 05:20:38 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:20:38.769960 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f8b83dca-11af-453e-8628-cfe15f3aafd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:38.770902 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f8b83dca-11af-453e-8628-cfe15f3aafd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:38.781010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8b83dca-11af-453e-8628-cfe15f3aafd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:38.781010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8b83dca-11af-453e-8628-cfe15f3aafd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:38.781010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8b83dca-11af-453e-8628-cfe15f3aafd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:38.781010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8b83dca-11af-453e-8628-cfe15f3aafd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:38.841915 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f8b83dca-11af-453e-8628-cfe15f3aafd0 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 27407 microversion: 2.20 time: 0.076071 Aug 10 05:20:38.846403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 330/655] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:38 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 27407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:20:39.542054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-2b3cca48-8a13-4830-b3f2-a021e1016045 req-50be5bdb-64db-4a9a-b6c8-18c6727a9fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0fbeaf1-6c57-45ec-9054-7bd64957f75b", "tag": "0f753a7a-5b22-4d1c-9dde-b5c1e567b981"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:39.543428 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:20:39.543428 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:20:39.552822 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-2b3cca48-8a13-4830-b3f2-a021e1016045 req-50be5bdb-64db-4a9a-b6c8-18c6727a9fea service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:39.553104 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-2b3cca48-8a13-4830-b3f2-a021e1016045 req-50be5bdb-64db-4a9a-b6c8-18c6727a9fea service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:39.565072 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-2b3cca48-8a13-4830-b3f2-a021e1016045 req-50be5bdb-64db-4a9a-b6c8-18c6727a9fea service nova] Creating event network-changed:0f753a7a-5b22-4d1c-9dde-b5c1e567b981 for instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b on hv-cinder-80390 Aug 10 05:20:39.569876 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-2b3cca48-8a13-4830-b3f2-a021e1016045 req-50be5bdb-64db-4a9a-b6c8-18c6727a9fea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031686 Aug 10 05:20:39.570618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 331/656] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:20:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:20:39.598364 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8161d28f-4f34-4acf-872c-bb7724c461d9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:39.599462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8161d28f-4f34-4acf-872c-bb7724c461d9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:39.605932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8161d28f-4f34-4acf-872c-bb7724c461d9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:39.606387 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8161d28f-4f34-4acf-872c-bb7724c461d9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:39.607230 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8161d28f-4f34-4acf-872c-bb7724c461d9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:39.607670 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8161d28f-4f34-4acf-872c-bb7724c461d9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:39.674850 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8161d28f-4f34-4acf-872c-bb7724c461d9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.139268 Aug 10 05:20:39.678004 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 326/657] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:39 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:20:39.853968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-40be5d05-7dd8-465e-a757-2adcf2419dd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:39.855062 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-40be5d05-7dd8-465e-a757-2adcf2419dd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:39.861594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-40be5d05-7dd8-465e-a757-2adcf2419dd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:39.862041 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-40be5d05-7dd8-465e-a757-2adcf2419dd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:39.862839 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-40be5d05-7dd8-465e-a757-2adcf2419dd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:39.863272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-40be5d05-7dd8-465e-a757-2adcf2419dd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:39.932732 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-40be5d05-7dd8-465e-a757-2adcf2419dd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 27887 microversion: 2.20 time: 0.082623 Aug 10 05:20:39.934389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 332/658] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:39 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 27887 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:20:40.686136 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ad2e6c4e-7097-450c-aba0-f561c92bda98 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:40.687136 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ad2e6c4e-7097-450c-aba0-f561c92bda98 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:40.694087 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad2e6c4e-7097-450c-aba0-f561c92bda98 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:40.697368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad2e6c4e-7097-450c-aba0-f561c92bda98 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:40.697368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad2e6c4e-7097-450c-aba0-f561c92bda98 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:40.697368 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad2e6c4e-7097-450c-aba0-f561c92bda98 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:40.757207 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ad2e6c4e-7097-450c-aba0-f561c92bda98 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.074927 Aug 10 05:20:40.757876 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 327/659] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:40 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:20:40.946362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7f581e5b-e308-402e-8615-38490e8007c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:40.947308 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7f581e5b-e308-402e-8615-38490e8007c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:40.953750 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f581e5b-e308-402e-8615-38490e8007c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:40.954196 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f581e5b-e308-402e-8615-38490e8007c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:40.955643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f581e5b-e308-402e-8615-38490e8007c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:40.956076 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7f581e5b-e308-402e-8615-38490e8007c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:41.018003 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7f581e5b-e308-402e-8615-38490e8007c9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 28197 microversion: 2.20 time: 0.075052 Aug 10 05:20:41.018633 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 333/660] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:40 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 28197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:41.768920 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a7031193-d53a-4b0e-aa90-b803174cbe06 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:41.769909 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a7031193-d53a-4b0e-aa90-b803174cbe06 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:41.776500 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a7031193-d53a-4b0e-aa90-b803174cbe06 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:41.776898 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a7031193-d53a-4b0e-aa90-b803174cbe06 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:41.777662 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a7031193-d53a-4b0e-aa90-b803174cbe06 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:41.778102 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a7031193-d53a-4b0e-aa90-b803174cbe06 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:41.836926 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a7031193-d53a-4b0e-aa90-b803174cbe06 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.072667 Aug 10 05:20:41.837511 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 328/661] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:41 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:20:42.029962 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2ca5f57a-b4a4-468d-bf5b-b458e16d9d4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:42.030931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2ca5f57a-b4a4-468d-bf5b-b458e16d9d4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:42.037395 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2ca5f57a-b4a4-468d-bf5b-b458e16d9d4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:42.037847 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2ca5f57a-b4a4-468d-bf5b-b458e16d9d4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:42.038638 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2ca5f57a-b4a4-468d-bf5b-b458e16d9d4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:42.039077 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2ca5f57a-b4a4-468d-bf5b-b458e16d9d4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:42.097946 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2ca5f57a-b4a4-468d-bf5b-b458e16d9d4c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 28197 microversion: 2.20 time: 0.072003 Aug 10 05:20:42.098544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 334/662] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:42 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 28197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:42.848676 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8db76588-09d2-4f76-bbde-1c9bc1fc0790 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:42.849595 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8db76588-09d2-4f76-bbde-1c9bc1fc0790 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:42.856108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8db76588-09d2-4f76-bbde-1c9bc1fc0790 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:42.856561 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8db76588-09d2-4f76-bbde-1c9bc1fc0790 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:42.857328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8db76588-09d2-4f76-bbde-1c9bc1fc0790 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:42.857768 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8db76588-09d2-4f76-bbde-1c9bc1fc0790 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:42.918731 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8db76588-09d2-4f76-bbde-1c9bc1fc0790 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.074626 Aug 10 05:20:42.919347 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 329/663] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:42 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:20:43.110507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ed8c8bea-5182-4f3a-a148-8216a27a1beb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:43.111620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ed8c8bea-5182-4f3a-a148-8216a27a1beb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:43.118224 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed8c8bea-5182-4f3a-a148-8216a27a1beb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:43.118705 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed8c8bea-5182-4f3a-a148-8216a27a1beb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:43.119468 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed8c8bea-5182-4f3a-a148-8216a27a1beb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:43.119905 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed8c8bea-5182-4f3a-a148-8216a27a1beb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:43.182682 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ed8c8bea-5182-4f3a-a148-8216a27a1beb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 28488 microversion: 2.20 time: 0.076240 Aug 10 05:20:43.183225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 335/664] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:43 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 28488 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:20:43.930044 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-980b8373-caa2-42cc-91d1-a9da8ae8c933 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:43.930988 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-980b8373-caa2-42cc-91d1-a9da8ae8c933 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:43.937560 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-980b8373-caa2-42cc-91d1-a9da8ae8c933 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:43.938010 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-980b8373-caa2-42cc-91d1-a9da8ae8c933 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:43.939296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-980b8373-caa2-42cc-91d1-a9da8ae8c933 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:43.939737 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-980b8373-caa2-42cc-91d1-a9da8ae8c933 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:44.003585 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-980b8373-caa2-42cc-91d1-a9da8ae8c933 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.077508 Aug 10 05:20:44.004185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 330/665] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:43 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:20:44.195112 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9a06bd85-4ab9-442c-abb0-18fbb82a3fc2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:44.196048 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9a06bd85-4ab9-442c-abb0-18fbb82a3fc2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:44.202425 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9a06bd85-4ab9-442c-abb0-18fbb82a3fc2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:44.202893 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9a06bd85-4ab9-442c-abb0-18fbb82a3fc2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:44.203649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9a06bd85-4ab9-442c-abb0-18fbb82a3fc2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:44.204079 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9a06bd85-4ab9-442c-abb0-18fbb82a3fc2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:44.266011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9a06bd85-4ab9-442c-abb0-18fbb82a3fc2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 28656 microversion: 2.20 time: 0.075130 Aug 10 05:20:44.266641 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 336/666] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:44 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 28656 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:20:45.014825 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b93638fd-f0cc-45e8-9272-e896a10580a5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:45.015825 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b93638fd-f0cc-45e8-9272-e896a10580a5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:45.022777 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b93638fd-f0cc-45e8-9272-e896a10580a5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:45.023231 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b93638fd-f0cc-45e8-9272-e896a10580a5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:45.023999 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b93638fd-f0cc-45e8-9272-e896a10580a5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:45.024438 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b93638fd-f0cc-45e8-9272-e896a10580a5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:45.089004 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b93638fd-f0cc-45e8-9272-e896a10580a5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.078050 Aug 10 05:20:45.089956 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 331/667] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:45 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 05:20:45.277373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-dc8c4850-2252-4922-99e0-430259af46ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:45.278352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-dc8c4850-2252-4922-99e0-430259af46ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:45.284882 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dc8c4850-2252-4922-99e0-430259af46ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:45.285365 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dc8c4850-2252-4922-99e0-430259af46ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:45.286130 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dc8c4850-2252-4922-99e0-430259af46ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:45.286592 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dc8c4850-2252-4922-99e0-430259af46ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:45.353321 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-dc8c4850-2252-4922-99e0-430259af46ad tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 28656 microversion: 2.20 time: 0.079981 Aug 10 05:20:45.353927 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 337/668] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:45 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 28656 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:20:46.100854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2a6630e2-c2e8-497c-aca3-e17113cbb1a1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:46.101855 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2a6630e2-c2e8-497c-aca3-e17113cbb1a1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:46.108441 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2a6630e2-c2e8-497c-aca3-e17113cbb1a1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:46.108894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2a6630e2-c2e8-497c-aca3-e17113cbb1a1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:46.109664 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2a6630e2-c2e8-497c-aca3-e17113cbb1a1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:46.110105 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2a6630e2-c2e8-497c-aca3-e17113cbb1a1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:46.167156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2a6630e2-c2e8-497c-aca3-e17113cbb1a1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.070228 Aug 10 05:20:46.167747 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 332/669] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:46 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 05:20:46.418010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b25b1491-bba6-4456-b00a-8ae727e2cbd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:46.419014 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b25b1491-bba6-4456-b00a-8ae727e2cbd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:46.424931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b25b1491-bba6-4456-b00a-8ae727e2cbd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:46.425375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b25b1491-bba6-4456-b00a-8ae727e2cbd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:46.426132 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b25b1491-bba6-4456-b00a-8ae727e2cbd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:46.426563 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b25b1491-bba6-4456-b00a-8ae727e2cbd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:46.491447 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b25b1491-bba6-4456-b00a-8ae727e2cbd5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 28656 microversion: 2.20 time: 0.130936 Aug 10 05:20:46.492030 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 338/670] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:46 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 28656 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:47.178843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-aa80d4ef-59da-4b73-9697-db0a43e188c2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:47.179849 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-aa80d4ef-59da-4b73-9697-db0a43e188c2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:47.186300 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-aa80d4ef-59da-4b73-9697-db0a43e188c2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:47.186789 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-aa80d4ef-59da-4b73-9697-db0a43e188c2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:47.187556 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-aa80d4ef-59da-4b73-9697-db0a43e188c2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:47.187998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-aa80d4ef-59da-4b73-9697-db0a43e188c2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:47.257961 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-aa80d4ef-59da-4b73-9697-db0a43e188c2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.082987 Aug 10 05:20:47.259236 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 333/671] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:47 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 05:20:47.503515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-05e8d3f7-ca99-4224-b3d1-2520e3029c10 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:47.504507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-05e8d3f7-ca99-4224-b3d1-2520e3029c10 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:47.510897 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05e8d3f7-ca99-4224-b3d1-2520e3029c10 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:47.511336 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05e8d3f7-ca99-4224-b3d1-2520e3029c10 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:47.512092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05e8d3f7-ca99-4224-b3d1-2520e3029c10 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:47.512523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05e8d3f7-ca99-4224-b3d1-2520e3029c10 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:47.576735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-05e8d3f7-ca99-4224-b3d1-2520e3029c10 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 28656 microversion: 2.20 time: 0.077239 Aug 10 05:20:47.577348 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 339/672] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:47 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 28656 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:48.269196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-88288065-24fa-4d89-a2d6-59a4c9df8697 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:48.270217 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-88288065-24fa-4d89-a2d6-59a4c9df8697 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:48.276899 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-88288065-24fa-4d89-a2d6-59a4c9df8697 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:48.277349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-88288065-24fa-4d89-a2d6-59a4c9df8697 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:48.278118 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-88288065-24fa-4d89-a2d6-59a4c9df8697 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:48.278558 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-88288065-24fa-4d89-a2d6-59a4c9df8697 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:48.342381 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-88288065-24fa-4d89-a2d6-59a4c9df8697 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.077134 Aug 10 05:20:48.343653 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 334/673] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:48 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:20:48.588757 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4377f363-69a4-4242-85fa-4d138818e9d5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:48.589756 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4377f363-69a4-4242-85fa-4d138818e9d5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:48.596714 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4377f363-69a4-4242-85fa-4d138818e9d5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:48.597161 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4377f363-69a4-4242-85fa-4d138818e9d5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:48.597931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4377f363-69a4-4242-85fa-4d138818e9d5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:48.598365 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4377f363-69a4-4242-85fa-4d138818e9d5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:48.661713 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4377f363-69a4-4242-85fa-4d138818e9d5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 30223 microversion: 2.20 time: 0.076901 Aug 10 05:20:48.662317 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 340/674] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:48 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 30223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:49.354286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0b65c557-96f6-42c1-a50c-f5a44a4886dd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:49.355350 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0b65c557-96f6-42c1-a50c-f5a44a4886dd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:49.362855 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0b65c557-96f6-42c1-a50c-f5a44a4886dd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:49.363302 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0b65c557-96f6-42c1-a50c-f5a44a4886dd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:49.364340 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0b65c557-96f6-42c1-a50c-f5a44a4886dd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:49.365068 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0b65c557-96f6-42c1-a50c-f5a44a4886dd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:49.439483 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0b65c557-96f6-42c1-a50c-f5a44a4886dd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 14 microversion: 2.1 time: 0.088605 Aug 10 05:20:49.440773 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 335/675] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:49 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:20:49.674377 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2b6e1d91-25bc-4f14-8376-626140ce59a3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:49.675306 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2b6e1d91-25bc-4f14-8376-626140ce59a3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:49.681698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b6e1d91-25bc-4f14-8376-626140ce59a3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:49.682145 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b6e1d91-25bc-4f14-8376-626140ce59a3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:49.682948 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b6e1d91-25bc-4f14-8376-626140ce59a3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:49.683386 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b6e1d91-25bc-4f14-8376-626140ce59a3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:49.744156 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2b6e1d91-25bc-4f14-8376-626140ce59a3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 32017 microversion: 2.20 time: 0.074376 Aug 10 05:20:49.744791 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 341/676] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:49 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 32017 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:50.450646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5e7f924a-eb76-4daa-a626-d7c7d9ec3e41 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:50.451634 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5e7f924a-eb76-4daa-a626-d7c7d9ec3e41 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:50.458708 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e7f924a-eb76-4daa-a626-d7c7d9ec3e41 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:50.459154 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e7f924a-eb76-4daa-a626-d7c7d9ec3e41 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:50.459916 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e7f924a-eb76-4daa-a626-d7c7d9ec3e41 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:50.460346 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e7f924a-eb76-4daa-a626-d7c7d9ec3e41 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:50.527644 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5e7f924a-eb76-4daa-a626-d7c7d9ec3e41 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 8434 microversion: 2.1 time: 0.080896 Aug 10 05:20:50.528272 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 336/677] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:50 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 8434 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:20:50.756144 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c34fdc38-c6af-4f0f-969c-45a902bdeaa6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:50.757143 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c34fdc38-c6af-4f0f-969c-45a902bdeaa6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:50.763529 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c34fdc38-c6af-4f0f-969c-45a902bdeaa6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:50.764435 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c34fdc38-c6af-4f0f-969c-45a902bdeaa6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:50.764794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c34fdc38-c6af-4f0f-969c-45a902bdeaa6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:50.765232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c34fdc38-c6af-4f0f-969c-45a902bdeaa6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:50.830481 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c34fdc38-c6af-4f0f-969c-45a902bdeaa6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 33312 microversion: 2.20 time: 0.078279 Aug 10 05:20:50.831145 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 342/678] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:50 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 33312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:51.539780 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6970a6de-e7ee-4bee-89f8-d483922fb6a8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:51.543382 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6970a6de-e7ee-4bee-89f8-d483922fb6a8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:51.547170 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6970a6de-e7ee-4bee-89f8-d483922fb6a8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:51.547619 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6970a6de-e7ee-4bee-89f8-d483922fb6a8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:51.548380 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6970a6de-e7ee-4bee-89f8-d483922fb6a8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:51.548816 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6970a6de-e7ee-4bee-89f8-d483922fb6a8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:51.611906 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6970a6de-e7ee-4bee-89f8-d483922fb6a8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 15753 microversion: 2.1 time: 0.076042 Aug 10 05:20:51.612727 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 337/679] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:51 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 15753 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:20:51.842953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-53bce570-4b2b-47a8-99c2-86617adba835 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:51.843865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-53bce570-4b2b-47a8-99c2-86617adba835 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:51.851003 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53bce570-4b2b-47a8-99c2-86617adba835 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:51.851449 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53bce570-4b2b-47a8-99c2-86617adba835 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:51.852218 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53bce570-4b2b-47a8-99c2-86617adba835 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:51.852650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53bce570-4b2b-47a8-99c2-86617adba835 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:51.922400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-53bce570-4b2b-47a8-99c2-86617adba835 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 34053 microversion: 2.20 time: 0.083533 Aug 10 05:20:51.923091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 343/680] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:51 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 34053 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:52.624212 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d16447fe-7742-4597-b6bf-60823b31b0cd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:52.625205 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d16447fe-7742-4597-b6bf-60823b31b0cd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:52.632686 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d16447fe-7742-4597-b6bf-60823b31b0cd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:52.633824 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d16447fe-7742-4597-b6bf-60823b31b0cd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:52.634922 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d16447fe-7742-4597-b6bf-60823b31b0cd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:52.635376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d16447fe-7742-4597-b6bf-60823b31b0cd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:52.701223 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d16447fe-7742-4597-b6bf-60823b31b0cd tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 18398 microversion: 2.1 time: 0.081018 Aug 10 05:20:52.703508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 338/681] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:52 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 18398 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:20:52.933803 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e115d02c-6df4-43de-8c74-966f040cabc7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:52.934866 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e115d02c-6df4-43de-8c74-966f040cabc7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:52.941263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e115d02c-6df4-43de-8c74-966f040cabc7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:52.941705 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e115d02c-6df4-43de-8c74-966f040cabc7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:52.942469 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e115d02c-6df4-43de-8c74-966f040cabc7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:52.942924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e115d02c-6df4-43de-8c74-966f040cabc7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:53.016037 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e115d02c-6df4-43de-8c74-966f040cabc7 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 35132 microversion: 2.20 time: 0.086090 Aug 10 05:20:53.017169 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 344/682] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:52 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 35132 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:53.713490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7924c8a5-2a41-4f3a-8f5b-401e845d31d7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:53.714489 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7924c8a5-2a41-4f3a-8f5b-401e845d31d7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:53.720961 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7924c8a5-2a41-4f3a-8f5b-401e845d31d7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:53.721416 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7924c8a5-2a41-4f3a-8f5b-401e845d31d7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:53.722182 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7924c8a5-2a41-4f3a-8f5b-401e845d31d7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:53.722641 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7924c8a5-2a41-4f3a-8f5b-401e845d31d7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:53.794646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7924c8a5-2a41-4f3a-8f5b-401e845d31d7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 19841 microversion: 2.1 time: 0.084997 Aug 10 05:20:53.795950 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 339/683] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:53 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 19841 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:20:54.028375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-541c17d1-8bd2-41c0-938e-3b1a94afc1bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:54.029391 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-541c17d1-8bd2-41c0-938e-3b1a94afc1bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:54.035775 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-541c17d1-8bd2-41c0-938e-3b1a94afc1bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:54.036220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-541c17d1-8bd2-41c0-938e-3b1a94afc1bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:54.036972 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-541c17d1-8bd2-41c0-938e-3b1a94afc1bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:54.037405 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-541c17d1-8bd2-41c0-938e-3b1a94afc1bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:54.100531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-541c17d1-8bd2-41c0-938e-3b1a94afc1bb tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 36579 microversion: 2.20 time: 0.075983 Aug 10 05:20:54.101092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 345/684] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:54 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 36579 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:54.806994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b8650ac3-bbaf-4cf8-9640-e704dc02843e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:54.807932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b8650ac3-bbaf-4cf8-9640-e704dc02843e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:54.814323 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b8650ac3-bbaf-4cf8-9640-e704dc02843e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:54.814799 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b8650ac3-bbaf-4cf8-9640-e704dc02843e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:54.815558 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b8650ac3-bbaf-4cf8-9640-e704dc02843e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:54.815988 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b8650ac3-bbaf-4cf8-9640-e704dc02843e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:54.880421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b8650ac3-bbaf-4cf8-9640-e704dc02843e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 22217 microversion: 2.1 time: 0.077469 Aug 10 05:20:54.881042 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 340/685] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:54 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 22217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:20:55.113010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f4bcac41-1405-4735-92e5-1c89a0a4e9b2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:55.114208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f4bcac41-1405-4735-92e5-1c89a0a4e9b2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:55.120625 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4bcac41-1405-4735-92e5-1c89a0a4e9b2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:55.121167 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4bcac41-1405-4735-92e5-1c89a0a4e9b2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:55.121938 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4bcac41-1405-4735-92e5-1c89a0a4e9b2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:55.122371 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f4bcac41-1405-4735-92e5-1c89a0a4e9b2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:55.182738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f4bcac41-1405-4735-92e5-1c89a0a4e9b2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 37944 microversion: 2.20 time: 0.073854 Aug 10 05:20:55.183444 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 346/686] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:55 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 37944 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:55.892322 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7077d7d1-8777-4f44-8054-dd321d548d33 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:55.893408 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7077d7d1-8777-4f44-8054-dd321d548d33 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:55.899905 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7077d7d1-8777-4f44-8054-dd321d548d33 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:55.900367 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7077d7d1-8777-4f44-8054-dd321d548d33 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:55.901146 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7077d7d1-8777-4f44-8054-dd321d548d33 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:55.901587 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7077d7d1-8777-4f44-8054-dd321d548d33 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:55.965906 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7077d7d1-8777-4f44-8054-dd321d548d33 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 23804 microversion: 2.1 time: 0.077555 Aug 10 05:20:55.966540 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 341/687] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:55 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 23804 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:20:56.194476 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a788c019-8873-4b96-8620-59678dcb1722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:56.195450 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a788c019-8873-4b96-8620-59678dcb1722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:56.201865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a788c019-8873-4b96-8620-59678dcb1722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:56.202314 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a788c019-8873-4b96-8620-59678dcb1722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:56.203107 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a788c019-8873-4b96-8620-59678dcb1722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:56.204047 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a788c019-8873-4b96-8620-59678dcb1722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:56.269895 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a788c019-8873-4b96-8620-59678dcb1722 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 38209 microversion: 2.20 time: 0.079278 Aug 10 05:20:56.270642 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 347/688] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:56 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 38209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:56.977903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4231b9c8-c730-45b8-b0d7-39e828cee516 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:56.978833 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4231b9c8-c730-45b8-b0d7-39e828cee516 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:56.985725 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4231b9c8-c730-45b8-b0d7-39e828cee516 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:56.986169 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4231b9c8-c730-45b8-b0d7-39e828cee516 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:56.986958 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4231b9c8-c730-45b8-b0d7-39e828cee516 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:56.987393 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4231b9c8-c730-45b8-b0d7-39e828cee516 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:57.052661 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4231b9c8-c730-45b8-b0d7-39e828cee516 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 25008 microversion: 2.1 time: 0.078863 Aug 10 05:20:57.053519 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 342/689] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:56 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 25008 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:20:57.283085 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ee2ca5b3-580c-4627-ad06-7ffa1c8b0ffe tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:57.284075 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ee2ca5b3-580c-4627-ad06-7ffa1c8b0ffe tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:57.290437 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ee2ca5b3-580c-4627-ad06-7ffa1c8b0ffe tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:57.290910 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ee2ca5b3-580c-4627-ad06-7ffa1c8b0ffe tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:57.291671 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ee2ca5b3-580c-4627-ad06-7ffa1c8b0ffe tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:57.292099 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ee2ca5b3-580c-4627-ad06-7ffa1c8b0ffe tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:57.368590 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ee2ca5b3-580c-4627-ad06-7ffa1c8b0ffe tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 38209 microversion: 2.20 time: 0.089991 Aug 10 05:20:57.369215 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 348/690] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:57 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 38209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:58.065009 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8406afe7-00d5-481c-8d99-7e4373ac7087 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:58.066005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8406afe7-00d5-481c-8d99-7e4373ac7087 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:58.072456 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8406afe7-00d5-481c-8d99-7e4373ac7087 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:58.072913 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8406afe7-00d5-481c-8d99-7e4373ac7087 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:58.073684 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8406afe7-00d5-481c-8d99-7e4373ac7087 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:58.074119 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8406afe7-00d5-481c-8d99-7e4373ac7087 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:58.136802 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8406afe7-00d5-481c-8d99-7e4373ac7087 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 26393 microversion: 2.1 time: 0.076169 Aug 10 05:20:58.137410 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 343/691] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:58 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 26393 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:20:58.381239 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-791230b5-67ae-43b4-89dd-c45a6993de08 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:58.382268 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-791230b5-67ae-43b4-89dd-c45a6993de08 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:58.388712 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-791230b5-67ae-43b4-89dd-c45a6993de08 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:58.389162 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-791230b5-67ae-43b4-89dd-c45a6993de08 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:58.389925 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-791230b5-67ae-43b4-89dd-c45a6993de08 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:58.390359 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-791230b5-67ae-43b4-89dd-c45a6993de08 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:58.458272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-791230b5-67ae-43b4-89dd-c45a6993de08 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 38209 microversion: 2.20 time: 0.080991 Aug 10 05:20:58.458923 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 349/692] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:58 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 38209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:59.148913 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-79130a70-8ff1-4442-975d-0384767068de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:59.149908 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-79130a70-8ff1-4442-975d-0384767068de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:59.157152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-79130a70-8ff1-4442-975d-0384767068de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:59.168333 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-79130a70-8ff1-4442-975d-0384767068de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:59.168333 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-79130a70-8ff1-4442-975d-0384767068de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:59.168333 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-79130a70-8ff1-4442-975d-0384767068de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:59.223740 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-79130a70-8ff1-4442-975d-0384767068de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 27394 microversion: 2.1 time: 0.078792 Aug 10 05:20:59.224388 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 344/693] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:20:59 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 27394 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:20:59.470667 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5986c56e-178a-41da-9a02-170c93cfdc91 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:20:59.471584 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5986c56e-178a-41da-9a02-170c93cfdc91 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:59.478065 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5986c56e-178a-41da-9a02-170c93cfdc91 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:59.478520 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5986c56e-178a-41da-9a02-170c93cfdc91 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:59.479311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5986c56e-178a-41da-9a02-170c93cfdc91 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:59.479775 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5986c56e-178a-41da-9a02-170c93cfdc91 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:59.556508 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5986c56e-178a-41da-9a02-170c93cfdc91 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 200 len: 38350 microversion: 2.20 time: 0.090658 Aug 10 05:20:59.557766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 350/694] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:20:59 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 38350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:20:59.567867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d37a046c-1320-415c-a4ba-1f3efe9ad6f3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:20:59.568446 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d37a046c-1320-415c-a4ba-1f3efe9ad6f3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:20:59.574890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d37a046c-1320-415c-a4ba-1f3efe9ad6f3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:59.575345 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d37a046c-1320-415c-a4ba-1f3efe9ad6f3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:59.576107 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d37a046c-1320-415c-a4ba-1f3efe9ad6f3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:20:59.576547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d37a046c-1320-415c-a4ba-1f3efe9ad6f3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:20:59.599400 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d37a046c-1320-415c-a4ba-1f3efe9ad6f3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/ips" status: 200 len: 152 microversion: 2.20 time: 0.035627 Aug 10 05:20:59.599953 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 345/695] 10.222.0.16 () {60 vars in 1289 bytes} [Tue Aug 10 05:20:59 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:00.235792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-603c8cfc-694d-421d-9f9a-4fa7b0d8ebaf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:00.236859 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-603c8cfc-694d-421d-9f9a-4fa7b0d8ebaf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:00.243596 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-603c8cfc-694d-421d-9f9a-4fa7b0d8ebaf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:00.244051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-603c8cfc-694d-421d-9f9a-4fa7b0d8ebaf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:00.244867 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-603c8cfc-694d-421d-9f9a-4fa7b0d8ebaf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:00.245305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-603c8cfc-694d-421d-9f9a-4fa7b0d8ebaf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:00.312874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-603c8cfc-694d-421d-9f9a-4fa7b0d8ebaf tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 27854 microversion: 2.1 time: 0.081676 Aug 10 05:21:00.313514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 351/696] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:00 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 27854 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:01.333585 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-699c952a-2d2d-40b9-a4da-8e64d156a115 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:01.334516 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-699c952a-2d2d-40b9-a4da-8e64d156a115 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:01.341079 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-699c952a-2d2d-40b9-a4da-8e64d156a115 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:01.341560 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-699c952a-2d2d-40b9-a4da-8e64d156a115 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:01.342323 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-699c952a-2d2d-40b9-a4da-8e64d156a115 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:01.342787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-699c952a-2d2d-40b9-a4da-8e64d156a115 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:01.406024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-699c952a-2d2d-40b9-a4da-8e64d156a115 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 28221 microversion: 2.1 time: 0.075901 Aug 10 05:21:01.406554 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 346/697] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:01 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 28221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:01.861965 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-34118f04-c74f-42cc-8fd9-0d3f7bfe4df4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:01.862636 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-34118f04-c74f-42cc-8fd9-0d3f7bfe4df4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:01.869380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-34118f04-c74f-42cc-8fd9-0d3f7bfe4df4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:01.869833 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-34118f04-c74f-42cc-8fd9-0d3f7bfe4df4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:01.870622 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-34118f04-c74f-42cc-8fd9-0d3f7bfe4df4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:01.871068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-34118f04-c74f-42cc-8fd9-0d3f7bfe4df4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:01.892943 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-34118f04-c74f-42cc-8fd9-0d3f7bfe4df4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lazy-loading 'flavor' on Instance uuid 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:21:02.418465 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-eca296e3-db0d-4715-b67a-dbc42ba03be9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:02.423708 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-34118f04-c74f-42cc-8fd9-0d3f7bfe4df4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 202 len: 0 microversion: 2.20 time: 0.561960 Aug 10 05:21:02.423842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-eca296e3-db0d-4715-b67a-dbc42ba03be9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:02.423949 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 352/698] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:21:01 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:21:02.427717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-eca296e3-db0d-4715-b67a-dbc42ba03be9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:02.428108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-eca296e3-db0d-4715-b67a-dbc42ba03be9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:02.428648 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:02.428888 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-eca296e3-db0d-4715-b67a-dbc42ba03be9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:02.429313 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:02.429432 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-eca296e3-db0d-4715-b67a-dbc42ba03be9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:02.435510 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:02.436025 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:02.436802 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:02.437239 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:02.493406 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-eca296e3-db0d-4715-b67a-dbc42ba03be9 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 28221 microversion: 2.1 time: 0.079365 Aug 10 05:21:02.494932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 347/699] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:02 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 28221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:21:02.558865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:02.567051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:02.568547 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:02.569670 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5f122797-9311-4b82-8855-6b397c286eaf tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.145060 Aug 10 05:21:02.570216 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 353/700] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:02 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:03.505710 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7eca6e08-a06d-4886-b986-40a6172f79d5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:03.506733 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7eca6e08-a06d-4886-b986-40a6172f79d5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:03.513179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7eca6e08-a06d-4886-b986-40a6172f79d5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:03.513671 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7eca6e08-a06d-4886-b986-40a6172f79d5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:03.514419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7eca6e08-a06d-4886-b986-40a6172f79d5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:03.514859 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7eca6e08-a06d-4886-b986-40a6172f79d5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:03.579260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7eca6e08-a06d-4886-b986-40a6172f79d5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 28348 microversion: 2.1 time: 0.077551 Aug 10 05:21:03.580129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 348/701] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:03 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 28348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:03.587970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:03.588585 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:03.595511 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:03.595964 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:03.596733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:03.597173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:03.717095 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:03.725448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:03.727033 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:03.728172 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5e6a84f1-ba72-47fc-941f-d9c43717ecd3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.143919 Aug 10 05:21:03.728731 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 354/702] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:03 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:04.590974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-88944194-051a-4742-b24b-79aaa4ccfe1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:04.592181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-88944194-051a-4742-b24b-79aaa4ccfe1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:04.598654 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-88944194-051a-4742-b24b-79aaa4ccfe1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:04.599110 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-88944194-051a-4742-b24b-79aaa4ccfe1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:04.599880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-88944194-051a-4742-b24b-79aaa4ccfe1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:04.600324 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-88944194-051a-4742-b24b-79aaa4ccfe1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:04.665075 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-88944194-051a-4742-b24b-79aaa4ccfe1f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 28512 microversion: 2.1 time: 0.078099 Aug 10 05:21:04.665704 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 349/703] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:04 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 28512 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:04.746553 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:04.747185 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:04.753244 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:04.753695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:04.754456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:04.754926 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:04.873719 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:04.881367 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:04.882884 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:04.884004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-261d1580-f77c-49b0-b6b4-dd58691cd2a5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.141233 Aug 10 05:21:04.884588 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 355/704] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:04 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:05.677063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d1dbad20-7930-49bc-88d8-042c270aaa72 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:05.678093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d1dbad20-7930-49bc-88d8-042c270aaa72 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:05.684554 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d1dbad20-7930-49bc-88d8-042c270aaa72 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:05.685008 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d1dbad20-7930-49bc-88d8-042c270aaa72 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:05.685774 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d1dbad20-7930-49bc-88d8-042c270aaa72 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:05.686213 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d1dbad20-7930-49bc-88d8-042c270aaa72 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:05.752441 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d1dbad20-7930-49bc-88d8-042c270aaa72 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 28680 microversion: 2.1 time: 0.079359 Aug 10 05:21:05.753739 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 350/705] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:05 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 28680 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:05.901543 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:05.902088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:05.908323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:05.908777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:05.909549 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:05.909987 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:06.026088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:06.033655 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:06.035164 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:06.036279 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d49ac253-14cf-43e3-9041-0b15a9e9f858 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.138473 Aug 10 05:21:06.036831 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 356/706] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:05 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:06.764442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7d1444c6-0f30-4c12-84fb-b3096ebfdac8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:06.765923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7d1444c6-0f30-4c12-84fb-b3096ebfdac8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:06.772340 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7d1444c6-0f30-4c12-84fb-b3096ebfdac8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:06.772786 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7d1444c6-0f30-4c12-84fb-b3096ebfdac8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:06.773591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7d1444c6-0f30-4c12-84fb-b3096ebfdac8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:06.773976 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7d1444c6-0f30-4c12-84fb-b3096ebfdac8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:06.839656 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7d1444c6-0f30-4c12-84fb-b3096ebfdac8 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 28680 microversion: 2.1 time: 0.079176 Aug 10 05:21:06.840266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 351/707] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:06 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 28680 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:07.054262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:07.054843 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:07.060631 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:07.061075 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:07.061832 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:07.062792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:07.178766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:07.186394 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:07.188419 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:07.189587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-05c083e6-214c-4b81-b51a-54b4cf171de3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.139050 Aug 10 05:21:07.190141 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 357/708] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:07 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:07.852296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c96fcc7b-51cb-4a5f-bde5-6d9b712dfb93 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:07.853220 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c96fcc7b-51cb-4a5f-bde5-6d9b712dfb93 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:07.859633 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c96fcc7b-51cb-4a5f-bde5-6d9b712dfb93 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:07.860712 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c96fcc7b-51cb-4a5f-bde5-6d9b712dfb93 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:07.861486 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c96fcc7b-51cb-4a5f-bde5-6d9b712dfb93 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:07.861927 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c96fcc7b-51cb-4a5f-bde5-6d9b712dfb93 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:07.929433 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c96fcc7b-51cb-4a5f-bde5-6d9b712dfb93 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 28680 microversion: 2.1 time: 0.081138 Aug 10 05:21:07.930045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 352/709] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:07 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 28680 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:21:08.207909 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:08.208461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:08.214412 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:08.214896 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:08.215662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:08.216103 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:08.336284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:08.344011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:08.346233 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:08.347391 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ff92a285-c61f-4666-86a6-6f7c087ceb17 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.143729 Aug 10 05:21:08.347958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 358/710] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:08 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:08.942177 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-50517089-9be4-44eb-a4a9-4564171707ad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:08.943108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-50517089-9be4-44eb-a4a9-4564171707ad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:08.949628 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50517089-9be4-44eb-a4a9-4564171707ad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:08.950082 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50517089-9be4-44eb-a4a9-4564171707ad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:08.950881 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50517089-9be4-44eb-a4a9-4564171707ad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:08.951318 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50517089-9be4-44eb-a4a9-4564171707ad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:09.022900 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-50517089-9be4-44eb-a4a9-4564171707ad tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 28970 microversion: 2.1 time: 0.085292 Aug 10 05:21:09.023532 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 353/711] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:08 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 28970 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:09.367164 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:09.367768 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:09.373466 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:09.373909 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:09.374689 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:09.375120 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:09.492711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:09.500290 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:09.501793 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:09.502934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1e8f7418-5f1c-4619-b96a-f7ddf03c1533 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.139712 Aug 10 05:21:09.503496 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 359/712] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:09 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:10.034357 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-64069635-8d08-4fe8-9dc0-fbcbb2d53a75 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:10.035326 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-64069635-8d08-4fe8-9dc0-fbcbb2d53a75 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:10.041682 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-64069635-8d08-4fe8-9dc0-fbcbb2d53a75 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:10.042144 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-64069635-8d08-4fe8-9dc0-fbcbb2d53a75 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:10.046635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-64069635-8d08-4fe8-9dc0-fbcbb2d53a75 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:10.046635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-64069635-8d08-4fe8-9dc0-fbcbb2d53a75 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:10.115555 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-64069635-8d08-4fe8-9dc0-fbcbb2d53a75 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 30879 microversion: 2.1 time: 0.085162 Aug 10 05:21:10.116413 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 354/713] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:10 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 30879 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:10.519891 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:10.520497 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:10.526784 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:10.527233 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:10.527992 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:10.528422 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:10.643795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:10.651543 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:10.653040 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:10.654202 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-da56536c-f748-4a74-8f40-f56cef514df3 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.138076 Aug 10 05:21:10.654794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 360/714] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:10 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:11.128329 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2ffd21af-69cf-4798-bee6-d95e5c92031b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:11.129332 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2ffd21af-69cf-4798-bee6-d95e5c92031b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:11.135867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ffd21af-69cf-4798-bee6-d95e5c92031b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:11.136330 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ffd21af-69cf-4798-bee6-d95e5c92031b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:11.137100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ffd21af-69cf-4798-bee6-d95e5c92031b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:11.137541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ffd21af-69cf-4798-bee6-d95e5c92031b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:11.207125 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2ffd21af-69cf-4798-bee6-d95e5c92031b tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 32454 microversion: 2.1 time: 0.082860 Aug 10 05:21:11.207741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 355/715] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:11 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 32454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:11.672500 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:11.673112 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:11.678837 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:11.679297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:11.680069 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:11.680510 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:11.808770 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:11.817185 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:11.818820 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:11.819954 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0386ca04-1637-4a75-ab22-043a36a33189 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.151372 Aug 10 05:21:11.820514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 361/716] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:11 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:12.219883 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-618e9233-851e-4fed-9b7f-5ac9d28c6927 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:12.220806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-618e9233-851e-4fed-9b7f-5ac9d28c6927 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:12.227225 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-618e9233-851e-4fed-9b7f-5ac9d28c6927 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:12.233541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-618e9233-851e-4fed-9b7f-5ac9d28c6927 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:12.233541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-618e9233-851e-4fed-9b7f-5ac9d28c6927 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:12.233541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-618e9233-851e-4fed-9b7f-5ac9d28c6927 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:12.293422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-618e9233-851e-4fed-9b7f-5ac9d28c6927 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 33274 microversion: 2.1 time: 0.077966 Aug 10 05:21:12.294050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 356/717] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:12 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 33274 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:12.837742 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:12.838322 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:12.844728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:12.845178 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:12.845947 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:12.846383 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:12.962665 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:12.970458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:12.971995 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:12.973123 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-26a62492-79ff-4ff6-8beb-3efed242257c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.139153 Aug 10 05:21:12.973667 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 362/718] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:12 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:13.306416 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-252c21bd-2d25-42d7-b08c-07d6a974cde4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:13.307442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-252c21bd-2d25-42d7-b08c-07d6a974cde4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:13.314466 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-252c21bd-2d25-42d7-b08c-07d6a974cde4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:13.314944 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-252c21bd-2d25-42d7-b08c-07d6a974cde4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:13.315715 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-252c21bd-2d25-42d7-b08c-07d6a974cde4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:13.316153 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-252c21bd-2d25-42d7-b08c-07d6a974cde4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:13.379932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-252c21bd-2d25-42d7-b08c-07d6a974cde4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 34094 microversion: 2.1 time: 0.077407 Aug 10 05:21:13.380566 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 357/719] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:13 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 34094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:13.991676 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:13.992283 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:13.998090 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:13.998535 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:13.999332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:13.999768 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:14.115906 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:14.123502 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:14.124984 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:14.126228 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-721f1731-17f4-4d41-8959-1ac480069713 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1745 microversion: 2.20 time: 0.138541 Aug 10 05:21:14.126813 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 363/720] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:13 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1745 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:14.392767 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5934c5ad-ef1e-4ac1-b7a1-3bf4ecd009fa tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:14.393765 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5934c5ad-ef1e-4ac1-b7a1-3bf4ecd009fa tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:14.400238 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5934c5ad-ef1e-4ac1-b7a1-3bf4ecd009fa tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:14.400694 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5934c5ad-ef1e-4ac1-b7a1-3bf4ecd009fa tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:14.401467 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5934c5ad-ef1e-4ac1-b7a1-3bf4ecd009fa tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:14.401900 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5934c5ad-ef1e-4ac1-b7a1-3bf4ecd009fa tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:14.469045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5934c5ad-ef1e-4ac1-b7a1-3bf4ecd009fa tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 35159 microversion: 2.1 time: 0.080761 Aug 10 05:21:14.469697 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 358/721] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:14 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 35159 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:15.144373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:15.144982 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:15.150967 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:15.151420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:15.152185 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:15.152621 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:15.272966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:15.280596 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:15.282702 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:15.283822 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-12178b91-f08a-4eef-a651-6dbb91154ee1 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1745 microversion: 2.20 time: 0.143256 Aug 10 05:21:15.284366 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 364/722] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:15 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1745 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:15.481638 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1dcaa98d-96b3-450f-b324-f3bf62dc0d3f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:15.482599 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1dcaa98d-96b3-450f-b324-f3bf62dc0d3f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:15.489983 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1dcaa98d-96b3-450f-b324-f3bf62dc0d3f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:15.490437 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1dcaa98d-96b3-450f-b324-f3bf62dc0d3f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:15.491238 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1dcaa98d-96b3-450f-b324-f3bf62dc0d3f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:15.491676 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1dcaa98d-96b3-450f-b324-f3bf62dc0d3f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:15.555170 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1dcaa98d-96b3-450f-b324-f3bf62dc0d3f tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 35809 microversion: 2.1 time: 0.077414 Aug 10 05:21:15.555827 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 359/723] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:15 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 35809 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:16.301602 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:16.302829 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:16.308628 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:16.315213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:16.315213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:16.315213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:16.440859 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:16.449405 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:16.451357 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:16.452718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b957e28c-d389-47d8-a80b-a6e29b9a317b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.154900 Aug 10 05:21:16.453795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 365/724] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:16 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:16.568063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a2c358fd-75e9-42c2-9067-b2c7cfc51bc0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:16.569819 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a2c358fd-75e9-42c2-9067-b2c7cfc51bc0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:16.576669 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a2c358fd-75e9-42c2-9067-b2c7cfc51bc0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:16.577201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a2c358fd-75e9-42c2-9067-b2c7cfc51bc0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:16.578045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a2c358fd-75e9-42c2-9067-b2c7cfc51bc0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:16.578621 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a2c358fd-75e9-42c2-9067-b2c7cfc51bc0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:16.650013 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a2c358fd-75e9-42c2-9067-b2c7cfc51bc0 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 37119 microversion: 2.1 time: 0.085846 Aug 10 05:21:16.654401 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 360/725] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:16 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 37119 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:21:17.473676 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:17.474294 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:17.483674 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:17.484458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:17.485276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:17.485884 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:17.618968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:17.627848 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:17.629631 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:17.632067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ed076415-2fb1-4b15-9993-94217bc60bc6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.162428 Aug 10 05:21:17.634500 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 366/726] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:17 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:17.662056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-938bd269-dc67-4bb1-b5c8-ed5b9fe9ded5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:17.663267 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-938bd269-dc67-4bb1-b5c8-ed5b9fe9ded5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:17.670274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-938bd269-dc67-4bb1-b5c8-ed5b9fe9ded5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:17.670852 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-938bd269-dc67-4bb1-b5c8-ed5b9fe9ded5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:17.672218 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-938bd269-dc67-4bb1-b5c8-ed5b9fe9ded5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:17.672759 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-938bd269-dc67-4bb1-b5c8-ed5b9fe9ded5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:17.745868 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-938bd269-dc67-4bb1-b5c8-ed5b9fe9ded5 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 38214 microversion: 2.1 time: 0.087679 Aug 10 05:21:17.747838 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 361/727] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:17 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 38214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:18.269523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-b48730d9-94dd-410b-bb89-4166bce4180c req-2ceb1878-5229-4916-a8f1-207f6149072e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef", "name": "network-vif-plugged", "status": "completed", "tag": "e218a600-deee-4780-bff5-a3a5af129359"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:18.271115 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:21:18.271115 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:21:18.278335 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-b48730d9-94dd-410b-bb89-4166bce4180c req-2ceb1878-5229-4916-a8f1-207f6149072e service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:18.278827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-b48730d9-94dd-410b-bb89-4166bce4180c req-2ceb1878-5229-4916-a8f1-207f6149072e service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:18.290605 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-b48730d9-94dd-410b-bb89-4166bce4180c req-2ceb1878-5229-4916-a8f1-207f6149072e service nova] Creating event network-vif-plugged:e218a600-deee-4780-bff5-a3a5af129359 for instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef on hv-cinder-80390 Aug 10 05:21:18.295809 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-b48730d9-94dd-410b-bb89-4166bce4180c req-2ceb1878-5229-4916-a8f1-207f6149072e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092338 Aug 10 05:21:18.296413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 367/728] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:21:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:21:18.652650 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:18.653442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:18.660291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:18.661007 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:18.661982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:18.662697 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:18.759596 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3978954a-3d4d-4e1c-9543-bdb5c614f295 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:18.760826 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3978954a-3d4d-4e1c-9543-bdb5c614f295 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:18.768570 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3978954a-3d4d-4e1c-9543-bdb5c614f295 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:18.769019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3978954a-3d4d-4e1c-9543-bdb5c614f295 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:18.769815 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3978954a-3d4d-4e1c-9543-bdb5c614f295 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:18.770248 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3978954a-3d4d-4e1c-9543-bdb5c614f295 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:18.815283 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:18.823673 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:18.825291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:18.826454 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-697904a6-c756-4c13-aa6b-7014c9a6b6bd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.178028 Aug 10 05:21:18.827047 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 362/729] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:18 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:18.854168 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3978954a-3d4d-4e1c-9543-bdb5c614f295 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 38214 microversion: 2.1 time: 0.098298 Aug 10 05:21:18.855217 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 368/730] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:18 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 38214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:21:19.845727 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:19.846271 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:19.853640 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:19.854212 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:19.855320 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:19.856391 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:19.865938 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f2d98c82-f8b2-4370-ab4e-393f7e0675de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:19.866957 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f2d98c82-f8b2-4370-ab4e-393f7e0675de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:19.887075 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f2d98c82-f8b2-4370-ab4e-393f7e0675de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:19.887814 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f2d98c82-f8b2-4370-ab4e-393f7e0675de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:19.888778 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f2d98c82-f8b2-4370-ab4e-393f7e0675de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:19.889220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f2d98c82-f8b2-4370-ab4e-393f7e0675de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:19.969920 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f2d98c82-f8b2-4370-ab4e-393f7e0675de tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 38214 microversion: 2.1 time: 0.107854 Aug 10 05:21:19.974478 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 369/731] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:19 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 38214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 05:21:20.018137 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:20.027496 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:20.028994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:20.030130 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-85945fe3-3db9-4808-8232-1451a7e2ac99 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.188773 Aug 10 05:21:20.032009 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 363/732] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:19 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:20.982931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-44722eb2-8ba2-46be-a3e7-4e0d6126ad79 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:20.983959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-44722eb2-8ba2-46be-a3e7-4e0d6126ad79 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:20.995761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-44722eb2-8ba2-46be-a3e7-4e0d6126ad79 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:20.996214 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-44722eb2-8ba2-46be-a3e7-4e0d6126ad79 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:20.997006 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-44722eb2-8ba2-46be-a3e7-4e0d6126ad79 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:20.997440 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-44722eb2-8ba2-46be-a3e7-4e0d6126ad79 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:21.050936 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:21.051656 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:21.061063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:21.061522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:21.062359 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:21.062833 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:21.072672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-44722eb2-8ba2-46be-a3e7-4e0d6126ad79 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action" status: 200 len: 38345 microversion: 2.1 time: 0.093611 Aug 10 05:21:21.078059 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 370/733] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:20 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/action => generated 38345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:21.085829 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b63fe7c5-6cdf-4c3e-9101-6bfda18c74eb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:21.086421 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b63fe7c5-6cdf-4c3e-9101-6bfda18c74eb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:21.103370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b63fe7c5-6cdf-4c3e-9101-6bfda18c74eb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:21.103933 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b63fe7c5-6cdf-4c3e-9101-6bfda18c74eb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:21.104847 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b63fe7c5-6cdf-4c3e-9101-6bfda18c74eb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:21.106180 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b63fe7c5-6cdf-4c3e-9101-6bfda18c74eb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:21.141716 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b63fe7c5-6cdf-4c3e-9101-6bfda18c74eb tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/ips" status: 200 len: 147 microversion: 2.1 time: 0.061489 Aug 10 05:21:21.147514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 371/734] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Aug 10 05:21:21 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/ips => generated 147 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:21:21.235932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:21.244834 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:21.246307 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:21.247616 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9a9f1dc0-57b2-4db9-a88e-9ebba7f5cb7d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.202333 Aug 10 05:21:21.248484 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 364/735] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:21 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:22.270548 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:22.274465 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:22.277000 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:22.277458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:22.278225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:22.278698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:22.403263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:22.411200 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:22.417193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:22.417193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0470080f-4f4f-4052-8c2f-83ce8f06e070 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.149944 Aug 10 05:21:22.417193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 372/736] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:22 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:22.749400 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c671eaf2-9686-4eaf-872a-dcc330dcd086 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2d1c624-e422-4fa6-b0ff-d47c4752fa59"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:22.751097 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c671eaf2-9686-4eaf-872a-dcc330dcd086 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:22.758027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c671eaf2-9686-4eaf-872a-dcc330dcd086 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:22.758520 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c671eaf2-9686-4eaf-872a-dcc330dcd086 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:22.759557 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c671eaf2-9686-4eaf-872a-dcc330dcd086 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:22.760005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c671eaf2-9686-4eaf-872a-dcc330dcd086 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:23.431086 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:23.432525 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:23.438763 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:23.439420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:23.440350 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:23.440934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:23.582176 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c671eaf2-9686-4eaf-872a-dcc330dcd086 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.836563 Aug 10 05:21:23.587548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 365/737] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:21:22 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:21:23.587831 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:23.597265 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:23.598909 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:23.600061 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b0edc587-3a7d-4aaa-8ba5-dd089e20abca tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.172721 Aug 10 05:21:23.611340 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 373/738] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:23 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:24.619628 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:24.620607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:24.628693 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:24.629278 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:24.630159 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:24.630966 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:24.760818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:24.769510 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:24.770966 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:24.772180 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ca8b95b3-4f33-4272-aaa3-119097fb7e77 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.156706 Aug 10 05:21:24.772754 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 366/739] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:24 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:25.791637 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:25.792380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:25.799313 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:25.799754 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:25.800555 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:25.800979 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:25.927179 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:25.938827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:25.940442 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:25.941834 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7ae2496c-75fd-4e6f-9b95-1413cba9fbfc tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.153924 Aug 10 05:21:25.942593 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 374/740] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:25 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:26.959627 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:26.960233 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:26.966453 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:26.966935 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:26.967702 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:26.968139 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:27.083887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:27.091458 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:27.092953 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:27.094081 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8f709b59-cee5-45eb-a2a1-ddbbecf3363a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1740 microversion: 2.20 time: 0.138121 Aug 10 05:21:27.094657 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 367/741] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:26 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1740 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:28.111409 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:28.112015 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:28.118005 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:28.118444 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:28.119242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:28.119676 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:28.240549 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:28.248480 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:28.250470 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:28.251647 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0f1b22d3-30ac-436b-bc07-a9ae0cf07158 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1722 microversion: 2.20 time: 0.144016 Aug 10 05:21:28.252791 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 375/742] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:28 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:29.269934 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:29.270552 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:29.276479 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:29.276930 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:29.277703 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:29.278142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:29.396046 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:29.403656 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:29.405164 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:29.406894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cf9a114e-4451-480a-bd8d-b397577f6b06 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1722 microversion: 2.20 time: 0.140760 Aug 10 05:21:29.407452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 368/743] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:29 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1722 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:30.424840 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:30.425446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:30.432274 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:30.432720 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:30.433485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:30.433971 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:30.556380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:30.564469 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:30.566000 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:30.567270 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aa9175f5-074c-45f6-b041-f53747c5a6e9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1725 microversion: 2.20 time: 0.147005 Aug 10 05:21:30.567823 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 376/744] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:30 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:30.584281 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7e40daa5-6e8a-496f-87d9-4d770d11aca5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b02cdf1e-498b-4556-b987-4222972e4a6d"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:30.585894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7e40daa5-6e8a-496f-87d9-4d770d11aca5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:30.591612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7e40daa5-6e8a-496f-87d9-4d770d11aca5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:30.592339 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7e40daa5-6e8a-496f-87d9-4d770d11aca5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:30.593350 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7e40daa5-6e8a-496f-87d9-4d770d11aca5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:30.593764 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7e40daa5-6e8a-496f-87d9-4d770d11aca5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:31.133860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b1f64d31-1b71-42db-9c90-3322a0cad9ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:31.134816 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b1f64d31-1b71-42db-9c90-3322a0cad9ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:31.141219 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1f64d31-1b71-42db-9c90-3322a0cad9ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:31.141673 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1f64d31-1b71-42db-9c90-3322a0cad9ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:31.142443 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1f64d31-1b71-42db-9c90-3322a0cad9ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:31.142923 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1f64d31-1b71-42db-9c90-3322a0cad9ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:31.172513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b1f64d31-1b71-42db-9c90-3322a0cad9ec tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 Aug 10 05:21:31.173061 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 377/745] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:21:31 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:21:31.182051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2c1e04da-ef15-46d2-8526-e3bf57f533b1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:31.182535 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2c1e04da-ef15-46d2-8526-e3bf57f533b1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:31.187904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2c1e04da-ef15-46d2-8526-e3bf57f533b1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:31.188351 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2c1e04da-ef15-46d2-8526-e3bf57f533b1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:31.189115 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2c1e04da-ef15-46d2-8526-e3bf57f533b1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:31.189554 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2c1e04da-ef15-46d2-8526-e3bf57f533b1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:31.219113 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2c1e04da-ef15-46d2-8526-e3bf57f533b1 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/f2d1c624-e422-4fa6-b0ff-d47c4752fa59" status: 200 len: 194 microversion: 2.1 time: 0.040333 Aug 10 05:21:31.219675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 378/746] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Aug 10 05:21:31 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/f2d1c624-e422-4fa6-b0ff-d47c4752fa59 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:21:31.589836 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7e40daa5-6e8a-496f-87d9-4d770d11aca5 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.009154 Aug 10 05:21:31.590375 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 369/747] 10.222.0.16 () {62 vars in 1364 bytes} [Tue Aug 10 05:21:30 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/os-volume_attachments => generated 188 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 05:21:31.710088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4c51bf33-1c97-4864-9a91-fb42ab7bd05e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:31.710088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4c51bf33-1c97-4864-9a91-fb42ab7bd05e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:31.712969 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c51bf33-1c97-4864-9a91-fb42ab7bd05e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:31.713426 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c51bf33-1c97-4864-9a91-fb42ab7bd05e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:31.714196 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c51bf33-1c97-4864-9a91-fb42ab7bd05e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:31.714665 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c51bf33-1c97-4864-9a91-fb42ab7bd05e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:32.291731 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-eedbfb3d-019b-4f94-915b-b5116ab68f07 req-37333b61-7d0a-4b8f-91ff-652ae23b0881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef", "name": "network-vif-unplugged", "status": "completed", "tag": "e218a600-deee-4780-bff5-a3a5af129359"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:32.293304 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:21:32.293304 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:21:32.301470 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-eedbfb3d-019b-4f94-915b-b5116ab68f07 req-37333b61-7d0a-4b8f-91ff-652ae23b0881 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:32.301922 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-eedbfb3d-019b-4f94-915b-b5116ab68f07 req-37333b61-7d0a-4b8f-91ff-652ae23b0881 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:32.311976 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.compute.server_external_events [req-eedbfb3d-019b-4f94-915b-b5116ab68f07 req-37333b61-7d0a-4b8f-91ff-652ae23b0881 service nova] Unable to find a host for instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef. Dropping event network-vif-unplugged {{(pid=108137) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 10 05:21:32.312878 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-eedbfb3d-019b-4f94-915b-b5116ab68f07 req-37333b61-7d0a-4b8f-91ff-652ae23b0881 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024972 Aug 10 05:21:32.313447 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 370/748] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:21:32 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 10 05:21:32.568343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4c51bf33-1c97-4864-9a91-fb42ab7bd05e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/os-volume_attachments/b02cdf1e-498b-4556-b987-4222972e4a6d" status: 202 len: 0 microversion: 2.20 time: 0.865177 Aug 10 05:21:32.568954 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 379/749] 10.222.0.16 () {60 vars in 1457 bytes} [Tue Aug 10 05:21:31 2021] DELETE /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/os-volume_attachments/b02cdf1e-498b-4556-b987-4222972e4a6d => generated 0 bytes in 867 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 05:21:32.626589 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c3aad6fa-3489-49af-a035-d243ce829839 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:32.627176 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c3aad6fa-3489-49af-a035-d243ce829839 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:32.632952 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c3aad6fa-3489-49af-a035-d243ce829839 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:32.633404 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c3aad6fa-3489-49af-a035-d243ce829839 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:32.634169 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c3aad6fa-3489-49af-a035-d243ce829839 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:32.634632 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c3aad6fa-3489-49af-a035-d243ce829839 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:32.811813 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c3aad6fa-3489-49af-a035-d243ce829839 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action" status: 202 len: 0 microversion: 2.20 time: 0.188898 Aug 10 05:21:32.812413 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 371/750] 10.222.0.16 () {62 vars in 1319 bytes} [Tue Aug 10 05:21:32 2021] POST /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:21:32.816795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-33d55fd2-6cf1-4585-b912-29473b770cf2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1cac4cf-9947-4e8d-809e-c03eb17b0ab2"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:32.817956 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-33d55fd2-6cf1-4585-b912-29473b770cf2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:32.820828 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:32.821514 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:32.823959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-33d55fd2-6cf1-4585-b912-29473b770cf2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:32.824830 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-33d55fd2-6cf1-4585-b912-29473b770cf2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:32.825618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-33d55fd2-6cf1-4585-b912-29473b770cf2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:32.826054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-33d55fd2-6cf1-4585-b912-29473b770cf2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:32.828413 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:32.834546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:32.834546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:32.834546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:32.952361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:32.961108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:32.962605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:32.963737 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c90a64eb-d279-40d2-8751-537383e0898f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1673 microversion: 2.20 time: 0.146730 Aug 10 05:21:32.964286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 372/751] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:32 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:33.561485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-33d55fd2-6cf1-4585-b912-29473b770cf2 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749321 Aug 10 05:21:33.562076 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 380/752] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:21:32 2021] POST /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:21:33.981534 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:33.982208 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:33.988919 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:33.989385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:33.990147 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:33.990605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:34.106598 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:34.115499 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:34.117005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:34.118142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-164c8024-6c4f-4461-97ed-4d85fd5701b8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1673 microversion: 2.20 time: 0.140397 Aug 10 05:21:34.118717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 373/753] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:33 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1673 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:35.137794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:35.138628 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:35.145247 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:35.145704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:35.146485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:35.146953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:35.268306 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:35.276022 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:35.277523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:35.278688 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4ee8a678-249a-45ae-8c7a-70ca311f4ee9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.145467 Aug 10 05:21:35.279246 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 381/754] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:35 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:35.754018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f51e9177-d877-42e3-b20c-f09f7ef44efa tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:35.754551 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f51e9177-d877-42e3-b20c-f09f7ef44efa tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:35.760472 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f51e9177-d877-42e3-b20c-f09f7ef44efa tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:35.760921 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f51e9177-d877-42e3-b20c-f09f7ef44efa tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:35.761689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f51e9177-d877-42e3-b20c-f09f7ef44efa tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:35.762129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f51e9177-d877-42e3-b20c-f09f7ef44efa tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:35.784250 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-f51e9177-d877-42e3-b20c-f09f7ef44efa tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lazy-loading 'flavor' on Instance uuid 766cb709-769b-418b-ad7e-d2360a7f57e8 {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:21:36.146290 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f51e9177-d877-42e3-b20c-f09f7ef44efa tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "POST /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8/action" status: 202 len: 0 microversion: 2.1 time: 0.395557 Aug 10 05:21:36.147029 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 374/755] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:35 2021] POST /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:21:36.155187 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-30f8a57e-7034-4252-a6c7-96a7bfb52bfd tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:36.155878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-30f8a57e-7034-4252-a6c7-96a7bfb52bfd tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:36.162745 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-30f8a57e-7034-4252-a6c7-96a7bfb52bfd tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:36.163413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-30f8a57e-7034-4252-a6c7-96a7bfb52bfd tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:36.164348 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-30f8a57e-7034-4252-a6c7-96a7bfb52bfd tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:36.164930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-30f8a57e-7034-4252-a6c7-96a7bfb52bfd tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:36.292728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-30f8a57e-7034-4252-a6c7-96a7bfb52bfd tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:36.297319 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:36.298700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:36.301062 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-30f8a57e-7034-4252-a6c7-96a7bfb52bfd tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.149521 Aug 10 05:21:36.301683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 382/756] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:36 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:36.305695 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:36.306138 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:36.306953 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:36.307387 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:36.437739 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:36.447100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:36.448712 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:36.449987 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-058bfeaf-b54c-4d3d-8a2b-24b9ca23efe4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.156777 Aug 10 05:21:36.450731 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 375/757] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:36 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:37.319282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2bce140f-192d-44b3-95be-50da040ee420 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:37.320110 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2bce140f-192d-44b3-95be-50da040ee420 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:37.326542 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2bce140f-192d-44b3-95be-50da040ee420 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:37.327018 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2bce140f-192d-44b3-95be-50da040ee420 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:37.327790 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2bce140f-192d-44b3-95be-50da040ee420 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:37.328230 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2bce140f-192d-44b3-95be-50da040ee420 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:37.452327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2bce140f-192d-44b3-95be-50da040ee420 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:37.461079 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2bce140f-192d-44b3-95be-50da040ee420 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.145390 Aug 10 05:21:37.468337 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 383/758] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:37 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:37.473762 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:37.474373 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:37.480465 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:37.480916 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:37.481688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:37.482124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:37.609390 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:37.620810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:37.622312 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:37.623501 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bdc74157-56ef-4127-86aa-5b5b9a39485a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.153480 Aug 10 05:21:37.624062 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 376/759] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:37 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:38.478049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c32bbd58-f13d-4b35-b9a4-6579160338a0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:38.478760 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c32bbd58-f13d-4b35-b9a4-6579160338a0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:38.484539 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c32bbd58-f13d-4b35-b9a4-6579160338a0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:38.485477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c32bbd58-f13d-4b35-b9a4-6579160338a0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:38.486241 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c32bbd58-f13d-4b35-b9a4-6579160338a0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:38.486709 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c32bbd58-f13d-4b35-b9a4-6579160338a0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:38.609230 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c32bbd58-f13d-4b35-b9a4-6579160338a0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:38.617649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c32bbd58-f13d-4b35-b9a4-6579160338a0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.143289 Aug 10 05:21:38.618211 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 384/760] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:38 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:38.640916 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:38.641615 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:38.647592 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:38.648114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:38.648951 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:38.649453 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:38.773349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:38.781979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:38.783490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:38.784641 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c9e652a5-c917-4dfc-8c46-195c818ec8e2 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.147404 Aug 10 05:21:38.785377 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 377/761] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:38 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:39.635709 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-476e5edf-25d0-460c-8cf0-bf791852b2dc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:39.636378 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-476e5edf-25d0-460c-8cf0-bf791852b2dc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:39.642302 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-476e5edf-25d0-460c-8cf0-bf791852b2dc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:39.642787 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-476e5edf-25d0-460c-8cf0-bf791852b2dc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:39.643562 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-476e5edf-25d0-460c-8cf0-bf791852b2dc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:39.644011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-476e5edf-25d0-460c-8cf0-bf791852b2dc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:39.804340 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:39.805670 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:39.813265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:39.814312 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:39.815382 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:39.816061 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:39.977845 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:40.003526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:40.005801 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:40.007131 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4bd10f09-712b-4919-b021-76fd336d8bc9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.207233 Aug 10 05:21:40.011139 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 378/762] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:39 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:40.036714 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-476e5edf-25d0-460c-8cf0-bf791852b2dc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:40.044368 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-476e5edf-25d0-460c-8cf0-bf791852b2dc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.413409 Aug 10 05:21:40.045526 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 385/763] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:39 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:41.031073 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:41.031726 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:41.037548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:41.038007 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:41.038815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:41.039263 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:41.061922 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c9bbf875-8f1b-4d45-adef-727420b72332 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:41.062536 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c9bbf875-8f1b-4d45-adef-727420b72332 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:41.072301 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c9bbf875-8f1b-4d45-adef-727420b72332 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:41.072748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c9bbf875-8f1b-4d45-adef-727420b72332 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:41.073525 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c9bbf875-8f1b-4d45-adef-727420b72332 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:41.073957 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c9bbf875-8f1b-4d45-adef-727420b72332 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:41.180513 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:41.188416 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:41.189897 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:41.191060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-972a4392-45c5-47b4-a452-94cbc68a025f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.163690 Aug 10 05:21:41.191621 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 379/764] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:41 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:41.206465 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c9bbf875-8f1b-4d45-adef-727420b72332 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:41.214132 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c9bbf875-8f1b-4d45-adef-727420b72332 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.156782 Aug 10 05:21:41.214727 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 386/765] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:41 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:42.209324 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:42.209960 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:42.216013 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:42.216464 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:42.217241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:42.217700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:42.231455 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9957ad35-80b7-4cec-b9f5-53dc4942bedf tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:42.236210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9957ad35-80b7-4cec-b9f5-53dc4942bedf tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:42.238523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9957ad35-80b7-4cec-b9f5-53dc4942bedf tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:42.239026 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9957ad35-80b7-4cec-b9f5-53dc4942bedf tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:42.239805 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9957ad35-80b7-4cec-b9f5-53dc4942bedf tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:42.240242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9957ad35-80b7-4cec-b9f5-53dc4942bedf tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:42.355993 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:42.363861 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:42.365496 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:42.366969 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8343d330-3bb1-414e-a928-c582bcdf133f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.161268 Aug 10 05:21:42.370617 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 380/766] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:42 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:42.385356 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9957ad35-80b7-4cec-b9f5-53dc4942bedf tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:42.393311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9957ad35-80b7-4cec-b9f5-53dc4942bedf tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.165473 Aug 10 05:21:42.393885 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 387/767] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:42 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:43.384675 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:43.385276 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:43.391220 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:43.391606 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:43.392374 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:43.392806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:43.410099 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ffd1b4e1-4725-4431-b55c-86c35d75a54d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:43.410792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ffd1b4e1-4725-4431-b55c-86c35d75a54d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:43.416672 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ffd1b4e1-4725-4431-b55c-86c35d75a54d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:43.417126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ffd1b4e1-4725-4431-b55c-86c35d75a54d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:43.417908 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ffd1b4e1-4725-4431-b55c-86c35d75a54d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:43.418344 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ffd1b4e1-4725-4431-b55c-86c35d75a54d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:43.523810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:43.534246 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:43.536066 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:43.537268 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-aac68e0b-5770-4560-91bc-0d9daf6e3425 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.156278 Aug 10 05:21:43.538181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 381/768] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:43 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:43.564818 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ffd1b4e1-4725-4431-b55c-86c35d75a54d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:43.572382 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ffd1b4e1-4725-4431-b55c-86c35d75a54d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.166760 Aug 10 05:21:43.573229 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 388/769] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:43 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:44.556058 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:44.556675 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:44.562724 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:44.563237 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:44.564522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:44.564970 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:44.589226 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8497fe27-30a9-48ac-a138-822d139deff8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:44.590518 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8497fe27-30a9-48ac-a138-822d139deff8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:44.611897 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8497fe27-30a9-48ac-a138-822d139deff8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:44.612612 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8497fe27-30a9-48ac-a138-822d139deff8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:44.613403 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8497fe27-30a9-48ac-a138-822d139deff8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:44.613835 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8497fe27-30a9-48ac-a138-822d139deff8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:44.690675 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:44.713376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:44.713376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:44.713376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-223205b6-d023-4fc9-8e34-35e23d26fb90 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.160684 Aug 10 05:21:44.718747 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 382/770] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:44 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:44.760522 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8497fe27-30a9-48ac-a138-822d139deff8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:44.768134 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8497fe27-30a9-48ac-a138-822d139deff8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.182557 Aug 10 05:21:44.768706 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 389/771] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:44 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:45.732371 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:45.733469 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:45.740575 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:45.741029 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:45.741815 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:45.742256 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:45.785352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3f4ad3be-646b-4341-bff8-bc7f4a249565 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:45.785936 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3f4ad3be-646b-4341-bff8-bc7f4a249565 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:45.791665 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3f4ad3be-646b-4341-bff8-bc7f4a249565 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:45.792108 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3f4ad3be-646b-4341-bff8-bc7f4a249565 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:45.792869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3f4ad3be-646b-4341-bff8-bc7f4a249565 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:45.793298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3f4ad3be-646b-4341-bff8-bc7f4a249565 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:45.863828 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:45.874844 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:45.874844 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:45.875063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2775c9de-5439-4c03-ab79-3c6090fea001 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.147208 Aug 10 05:21:45.875504 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 383/772] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:45 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:45.911768 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3f4ad3be-646b-4341-bff8-bc7f4a249565 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:45.918977 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3f4ad3be-646b-4341-bff8-bc7f4a249565 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.137878 Aug 10 05:21:45.919531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 390/773] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:45 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:46.892615 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:46.893198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:46.898903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:46.899352 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:46.900109 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:46.900541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:46.935969 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e739d1df-8b48-4843-81bf-651d2800ecc4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:46.936601 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e739d1df-8b48-4843-81bf-651d2800ecc4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:46.942612 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e739d1df-8b48-4843-81bf-651d2800ecc4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:46.943071 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e739d1df-8b48-4843-81bf-651d2800ecc4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:46.943837 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e739d1df-8b48-4843-81bf-651d2800ecc4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:46.944271 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e739d1df-8b48-4843-81bf-651d2800ecc4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:47.020053 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:47.028160 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:47.029719 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:47.030933 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-138ab9dc-5aff-4c13-8fbd-a4c0d1d7ac52 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.141967 Aug 10 05:21:47.031495 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 384/774] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:46 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:47.065838 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-e739d1df-8b48-4843-81bf-651d2800ecc4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:47.073113 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e739d1df-8b48-4843-81bf-651d2800ecc4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.140757 Aug 10 05:21:47.073670 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 391/775] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:46 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:48.049532 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:48.050076 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:48.055898 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.056328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.057088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.057523 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.088988 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2bc0ef58-5d31-49e1-933a-773646071167 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:48.089725 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2bc0ef58-5d31-49e1-933a-773646071167 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:48.095726 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2bc0ef58-5d31-49e1-933a-773646071167 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.096251 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2bc0ef58-5d31-49e1-933a-773646071167 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.097030 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2bc0ef58-5d31-49e1-933a-773646071167 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.097464 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2bc0ef58-5d31-49e1-933a-773646071167 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.172364 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:48.181007 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:48.182515 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:48.183688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a235164b-1421-4069-9df4-3a7ec05eda3a tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.138407 Aug 10 05:21:48.184252 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 385/776] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:48 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:48.214894 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2bc0ef58-5d31-49e1-933a-773646071167 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:48.222021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2bc0ef58-5d31-49e1-933a-773646071167 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.136713 Aug 10 05:21:48.222651 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 392/777] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:48 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:48.539982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-122ac735-521d-4a04-a9e8-bca1a0463884 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:48.540950 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-122ac735-521d-4a04-a9e8-bca1a0463884 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:48.546732 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-122ac735-521d-4a04-a9e8-bca1a0463884 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.547187 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-122ac735-521d-4a04-a9e8-bca1a0463884 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.547951 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-122ac735-521d-4a04-a9e8-bca1a0463884 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.549013 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-122ac735-521d-4a04-a9e8-bca1a0463884 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.577443 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-122ac735-521d-4a04-a9e8-bca1a0463884 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041143 Aug 10 05:21:48.577986 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 386/778] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:21:48 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:21:48.778958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9d58b3b5-bcb0-427a-a39f-1c85372b7dcc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:48.779456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9d58b3b5-bcb0-427a-a39f-1c85372b7dcc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:48.785825 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9d58b3b5-bcb0-427a-a39f-1c85372b7dcc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.786275 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9d58b3b5-bcb0-427a-a39f-1c85372b7dcc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.787102 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9d58b3b5-bcb0-427a-a39f-1c85372b7dcc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.787545 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9d58b3b5-bcb0-427a-a39f-1c85372b7dcc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.815692 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9d58b3b5-bcb0-427a-a39f-1c85372b7dcc tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/f2d1c624-e422-4fa6-b0ff-d47c4752fa59" status: 200 len: 194 microversion: 2.1 time: 0.040536 Aug 10 05:21:48.816253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 393/779] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Aug 10 05:21:48 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/f2d1c624-e422-4fa6-b0ff-d47c4752fa59 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:21:48.826346 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3f651c87-1ee1-4e66-bc82-55e64a9ab10e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:48.826966 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3f651c87-1ee1-4e66-bc82-55e64a9ab10e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:48.833323 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3f651c87-1ee1-4e66-bc82-55e64a9ab10e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.833777 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3f651c87-1ee1-4e66-bc82-55e64a9ab10e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.834569 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3f651c87-1ee1-4e66-bc82-55e64a9ab10e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:48.835019 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3f651c87-1ee1-4e66-bc82-55e64a9ab10e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:48.916728 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-3f651c87-1ee1-4e66-bc82-55e64a9ab10e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lazy-loading 'services' on Instance uuid d0fbeaf1-6c57-45ec-9054-7bd64957f75b {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:21:49.114142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3f651c87-1ee1-4e66-bc82-55e64a9ab10e tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/f2d1c624-e422-4fa6-b0ff-d47c4752fa59" status: 202 len: 0 microversion: 2.1 time: 0.291289 Aug 10 05:21:49.114786 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 387/780] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:21:48 2021] DELETE /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/f2d1c624-e422-4fa6-b0ff-d47c4752fa59 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:21:49.201894 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:49.202497 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:49.209352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:49.209807 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:49.210603 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:49.211048 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:49.247083 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e09c9fa5-272d-4037-b1c4-9877b94c64b7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:49.248328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e09c9fa5-272d-4037-b1c4-9877b94c64b7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:49.254759 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e09c9fa5-272d-4037-b1c4-9877b94c64b7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:49.255216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e09c9fa5-272d-4037-b1c4-9877b94c64b7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:49.256000 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e09c9fa5-272d-4037-b1c4-9877b94c64b7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:49.256439 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e09c9fa5-272d-4037-b1c4-9877b94c64b7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:49.332376 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:49.340253 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:49.341745 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:49.342903 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ed8bedce-8075-4fe9-88f0-8f880ecb3843 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.144881 Aug 10 05:21:49.343461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 394/781] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:49 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:21:49.377032 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e09c9fa5-272d-4037-b1c4-9877b94c64b7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:49.384317 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e09c9fa5-272d-4037-b1c4-9877b94c64b7 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.141120 Aug 10 05:21:49.384875 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 388/782] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:49 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:50.361846 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:50.362880 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:50.369140 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:50.369632 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:50.370416 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:50.370878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:50.401176 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-72a15f04-94d3-46fc-b42c-0fb3ad667ea0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:50.401802 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-72a15f04-94d3-46fc-b42c-0fb3ad667ea0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:50.408388 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-72a15f04-94d3-46fc-b42c-0fb3ad667ea0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:50.409096 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-72a15f04-94d3-46fc-b42c-0fb3ad667ea0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:50.409901 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-72a15f04-94d3-46fc-b42c-0fb3ad667ea0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:50.410478 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-72a15f04-94d3-46fc-b42c-0fb3ad667ea0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:50.498297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:50.506853 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:50.508358 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:50.509572 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6e0e164a-0284-49cf-97ad-d8922be40e94 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.152024 Aug 10 05:21:50.510335 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 395/783] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:50 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:50.543948 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-72a15f04-94d3-46fc-b42c-0fb3ad667ea0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:50.551861 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-72a15f04-94d3-46fc-b42c-0fb3ad667ea0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.154538 Aug 10 05:21:50.552426 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 389/784] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:50 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:51.281895 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f9fa3194-7483-48b9-9295-5b48178668d6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:51.282388 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f9fa3194-7483-48b9-9295-5b48178668d6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:51.288133 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f9fa3194-7483-48b9-9295-5b48178668d6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:51.288590 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f9fa3194-7483-48b9-9295-5b48178668d6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:51.289366 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f9fa3194-7483-48b9-9295-5b48178668d6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:51.289808 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f9fa3194-7483-48b9-9295-5b48178668d6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:51.318320 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f9fa3194-7483-48b9-9295-5b48178668d6 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/d1cac4cf-9947-4e8d-809e-c03eb17b0ab2" status: 200 len: 194 microversion: 2.1 time: 0.040205 Aug 10 05:21:51.318914 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 396/785] 10.222.0.16 () {58 vars in 1413 bytes} [Tue Aug 10 05:21:51 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/d1cac4cf-9947-4e8d-809e-c03eb17b0ab2 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:21:51.328108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5e2476d2-6f2c-4feb-85a8-351010a47def tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:51.328609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5e2476d2-6f2c-4feb-85a8-351010a47def tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:51.334339 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e2476d2-6f2c-4feb-85a8-351010a47def tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:51.334844 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e2476d2-6f2c-4feb-85a8-351010a47def tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:51.335624 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e2476d2-6f2c-4feb-85a8-351010a47def tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:51.336068 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5e2476d2-6f2c-4feb-85a8-351010a47def tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:51.417196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-5e2476d2-6f2c-4feb-85a8-351010a47def tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lazy-loading 'services' on Instance uuid d0fbeaf1-6c57-45ec-9054-7bd64957f75b {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:21:51.527392 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:51.528029 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:51.534551 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:51.535021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:51.535821 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:51.536248 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:51.601966 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5e2476d2-6f2c-4feb-85a8-351010a47def tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/d1cac4cf-9947-4e8d-809e-c03eb17b0ab2" status: 202 len: 0 microversion: 2.1 time: 0.277340 Aug 10 05:21:51.602561 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 390/786] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:21:51 2021] DELETE /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments/d1cac4cf-9947-4e8d-809e-c03eb17b0ab2 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:21:51.607941 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4353daaf-9fe1-4f80-9b49-d81c0f3e6466 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:51.608172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4353daaf-9fe1-4f80-9b49-d81c0f3e6466 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:51.615495 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4353daaf-9fe1-4f80-9b49-d81c0f3e6466 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:51.615955 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4353daaf-9fe1-4f80-9b49-d81c0f3e6466 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:51.616723 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4353daaf-9fe1-4f80-9b49-d81c0f3e6466 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:51.617591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4353daaf-9fe1-4f80-9b49-d81c0f3e6466 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:51.669744 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:51.678462 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:51.680049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:51.681205 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9eea0993-2d27-479d-9396-190bf58b445e tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.157561 Aug 10 05:21:51.682506 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 397/787] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:51 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:51.745546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4353daaf-9fe1-4f80-9b49-d81c0f3e6466 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:51.752935 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4353daaf-9fe1-4f80-9b49-d81c0f3e6466 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.149108 Aug 10 05:21:51.758345 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 391/788] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:51 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:52.444627 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-06696d0e-e9a7-43c8-9c65-26a515a612ef req-ef816080-4619-4403-a722-37c6d742fef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef", "name": "network-vif-plugged", "status": "completed", "tag": "e218a600-deee-4780-bff5-a3a5af129359"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:52.446997 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:21:52.446997 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:21:52.453332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-06696d0e-e9a7-43c8-9c65-26a515a612ef req-ef816080-4619-4403-a722-37c6d742fef3 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:52.453774 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-06696d0e-e9a7-43c8-9c65-26a515a612ef req-ef816080-4619-4403-a722-37c6d742fef3 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:52.464685 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-06696d0e-e9a7-43c8-9c65-26a515a612ef req-ef816080-4619-4403-a722-37c6d742fef3 service nova] Creating event network-vif-plugged:e218a600-deee-4780-bff5-a3a5af129359 for instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef on hv-cinder-80390 Aug 10 05:21:52.469541 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-06696d0e-e9a7-43c8-9c65-26a515a612ef req-ef816080-4619-4403-a722-37c6d742fef3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028608 Aug 10 05:21:52.470843 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 398/789] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:21:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:21:52.702256 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:52.702895 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:52.709581 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:52.710044 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:52.710848 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:52.711459 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:52.779120 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b48ce85f-7795-4837-a249-2f5b34f851fe tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:52.781386 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b48ce85f-7795-4837-a249-2f5b34f851fe tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:52.786952 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b48ce85f-7795-4837-a249-2f5b34f851fe tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:52.787409 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b48ce85f-7795-4837-a249-2f5b34f851fe tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:52.788190 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b48ce85f-7795-4837-a249-2f5b34f851fe tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:52.788625 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b48ce85f-7795-4837-a249-2f5b34f851fe tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:52.889690 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:52.898105 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:52.899655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:52.900985 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3acc8a40-f777-4a5a-8e69-6e695e1fd53f tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.202231 Aug 10 05:21:52.901553 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 392/790] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:52 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:52.912938 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4257ae24-4d1b-4583-96d1-c7b6d6569131 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:52.912938 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4257ae24-4d1b-4583-96d1-c7b6d6569131 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:52.913497 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b48ce85f-7795-4837-a249-2f5b34f851fe tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:52.914133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4257ae24-4d1b-4583-96d1-c7b6d6569131 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:52.914666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4257ae24-4d1b-4583-96d1-c7b6d6569131 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:52.915418 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4257ae24-4d1b-4583-96d1-c7b6d6569131 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:52.915859 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4257ae24-4d1b-4583-96d1-c7b6d6569131 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:52.918971 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b48ce85f-7795-4837-a249-2f5b34f851fe tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.153000 Aug 10 05:21:52.919547 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 399/791] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:52 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:52.945674 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4257ae24-4d1b-4583-96d1-c7b6d6569131 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043117 Aug 10 05:21:52.946219 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 393/792] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:21:52 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:21:53.056316 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a0884b16-d6ca-409f-9191-3d542cf9d704 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:53.057225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a0884b16-d6ca-409f-9191-3d542cf9d704 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:53.062846 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a0884b16-d6ca-409f-9191-3d542cf9d704 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.063294 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a0884b16-d6ca-409f-9191-3d542cf9d704 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.064542 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a0884b16-d6ca-409f-9191-3d542cf9d704 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.064969 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a0884b16-d6ca-409f-9191-3d542cf9d704 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.093111 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a0884b16-d6ca-409f-9191-3d542cf9d704 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040443 Aug 10 05:21:53.093583 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 400/793] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:21:53 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:21:53.158418 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b3b6d29d-e6f5-41d1-b0ed-140132d4da51 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:53.159187 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b3b6d29d-e6f5-41d1-b0ed-140132d4da51 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:53.167588 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b3b6d29d-e6f5-41d1-b0ed-140132d4da51 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.168266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b3b6d29d-e6f5-41d1-b0ed-140132d4da51 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.169416 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b3b6d29d-e6f5-41d1-b0ed-140132d4da51 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.170071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b3b6d29d-e6f5-41d1-b0ed-140132d4da51 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.201384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b3b6d29d-e6f5-41d1-b0ed-140132d4da51 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Going to try to terminate instance {{(pid=108137) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:21:53.503882 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b3b6d29d-e6f5-41d1-b0ed-140132d4da51 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 204 len: 0 microversion: 2.1 time: 0.350912 Aug 10 05:21:53.504474 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 394/794] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:21:53 2021] DELETE /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:21:53.512710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-05d48b6f-4a68-4e9d-98cd-2ae193974cf7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:53.513351 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-05d48b6f-4a68-4e9d-98cd-2ae193974cf7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:53.519567 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05d48b6f-4a68-4e9d-98cd-2ae193974cf7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.520027 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05d48b6f-4a68-4e9d-98cd-2ae193974cf7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.520806 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05d48b6f-4a68-4e9d-98cd-2ae193974cf7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.521242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-05d48b6f-4a68-4e9d-98cd-2ae193974cf7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.645420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-05d48b6f-4a68-4e9d-98cd-2ae193974cf7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:53.652957 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-05d48b6f-4a68-4e9d-98cd-2ae193974cf7 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1675 microversion: 2.1 time: 0.144176 Aug 10 05:21:53.653525 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 401/795] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:53 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1675 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:53.920383 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:53.921287 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:53.928188 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.928640 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.929675 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.930011 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.934947 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-89c9f88a-6ced-4167-a181-1402cb3c6297 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:53.936071 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-89c9f88a-6ced-4167-a181-1402cb3c6297 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:53.942912 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89c9f88a-6ced-4167-a181-1402cb3c6297 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.943546 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89c9f88a-6ced-4167-a181-1402cb3c6297 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:53.944795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89c9f88a-6ced-4167-a181-1402cb3c6297 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:53.945646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89c9f88a-6ced-4167-a181-1402cb3c6297 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:54.078532 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-89c9f88a-6ced-4167-a181-1402cb3c6297 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:54.087028 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-89c9f88a-6ced-4167-a181-1402cb3c6297 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.155558 Aug 10 05:21:54.087612 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 402/796] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:53 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:54.120394 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:54.128323 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:54.129836 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:54.131032 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3b277e41-5b2f-4f7e-b587-fb9e6ed13f27 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1731 microversion: 2.20 time: 0.214895 Aug 10 05:21:54.131893 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 395/797] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:53 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:54.669865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f714f560-78ac-4f43-8cb7-2559a5216716 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:54.670389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f714f560-78ac-4f43-8cb7-2559a5216716 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:54.676146 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f714f560-78ac-4f43-8cb7-2559a5216716 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:54.676589 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f714f560-78ac-4f43-8cb7-2559a5216716 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:54.677346 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f714f560-78ac-4f43-8cb7-2559a5216716 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:54.677776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f714f560-78ac-4f43-8cb7-2559a5216716 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:54.799402 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f714f560-78ac-4f43-8cb7-2559a5216716 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:54.806688 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f714f560-78ac-4f43-8cb7-2559a5216716 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1675 microversion: 2.1 time: 0.140621 Aug 10 05:21:54.807353 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 403/798] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:54 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:55.105623 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f8d8bc77-1382-40bc-b256-c06ae55f1218 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:55.106263 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f8d8bc77-1382-40bc-b256-c06ae55f1218 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:55.112765 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f8d8bc77-1382-40bc-b256-c06ae55f1218 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:55.113212 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f8d8bc77-1382-40bc-b256-c06ae55f1218 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:55.113987 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f8d8bc77-1382-40bc-b256-c06ae55f1218 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:55.114419 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f8d8bc77-1382-40bc-b256-c06ae55f1218 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:55.149384 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:55.149993 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:55.155929 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:55.156378 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:55.157257 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:55.158204 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:55.240172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f8d8bc77-1382-40bc-b256-c06ae55f1218 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:55.247474 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f8d8bc77-1382-40bc-b256-c06ae55f1218 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.145671 Aug 10 05:21:55.248038 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 396/799] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:55 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:55.286336 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:55.294250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:55.295792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:55.296936 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7711041c-aecc-43cf-8d48-1c3cc0e52c8b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1718 microversion: 2.20 time: 0.151282 Aug 10 05:21:55.297496 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 404/800] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:21:55 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:21:55.824916 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a059b206-844d-42ff-85dd-2b7c7e8e8049 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:55.825441 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a059b206-844d-42ff-85dd-2b7c7e8e8049 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:55.832216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a059b206-844d-42ff-85dd-2b7c7e8e8049 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:55.832687 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a059b206-844d-42ff-85dd-2b7c7e8e8049 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:55.833455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a059b206-844d-42ff-85dd-2b7c7e8e8049 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:55.833894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a059b206-844d-42ff-85dd-2b7c7e8e8049 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:56.248093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a059b206-844d-42ff-85dd-2b7c7e8e8049 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:56.255950 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a059b206-844d-42ff-85dd-2b7c7e8e8049 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1675 microversion: 2.1 time: 0.434860 Aug 10 05:21:56.256802 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 397/801] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:55 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1675 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:56.264243 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6b212196-857d-466a-b4a8-e1cf1a0098c4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:56.264854 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6b212196-857d-466a-b4a8-e1cf1a0098c4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:56.276748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6b212196-857d-466a-b4a8-e1cf1a0098c4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:56.277195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6b212196-857d-466a-b4a8-e1cf1a0098c4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:56.278056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6b212196-857d-466a-b4a8-e1cf1a0098c4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:56.278491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6b212196-857d-466a-b4a8-e1cf1a0098c4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:56.398985 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6b212196-857d-466a-b4a8-e1cf1a0098c4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:56.407054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6b212196-857d-466a-b4a8-e1cf1a0098c4 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.146413 Aug 10 05:21:56.407629 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 405/802] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:56 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:21:56.752622 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-beacd878-cbdf-415b-a56c-39e498d5b09b req-d1938ef4-863f-4d8d-a846-215efbc7d8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0fbeaf1-6c57-45ec-9054-7bd64957f75b", "name": "network-vif-deleted", "tag": "0f753a7a-5b22-4d1c-9dde-b5c1e567b981"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:56.754202 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:21:56.754202 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:21:56.762402 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-beacd878-cbdf-415b-a56c-39e498d5b09b req-d1938ef4-863f-4d8d-a846-215efbc7d8ac service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:56.767529 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-beacd878-cbdf-415b-a56c-39e498d5b09b req-d1938ef4-863f-4d8d-a846-215efbc7d8ac service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:56.780492 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-beacd878-cbdf-415b-a56c-39e498d5b09b req-d1938ef4-863f-4d8d-a846-215efbc7d8ac service nova] Creating event network-vif-deleted:0f753a7a-5b22-4d1c-9dde-b5c1e567b981 for instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b on hv-cinder-80390 Aug 10 05:21:56.786512 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-beacd878-cbdf-415b-a56c-39e498d5b09b req-d1938ef4-863f-4d8d-a846-215efbc7d8ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096313 Aug 10 05:21:56.787939 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 398/803] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:21:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:21:57.273233 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:57.274029 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:57.279827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:57.280284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:57.281059 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:57.281537 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:57.312224 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:57.312671 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:57.313113 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lazy-loading 'fault' on Instance uuid d0fbeaf1-6c57-45ec-9054-7bd64957f75b {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:21:57.354173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '490a8522f743475187844c39a4ba6dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72a3bb25c2374aa8a148b26d66d2eda1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:57.361582 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3b9991f9-0039-4ce9-bf52-e0f97f07c488 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 200 len: 1328 microversion: 2.1 time: 0.092087 Aug 10 05:21:57.362735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 406/804] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:57 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:57.424464 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-48437434-9a6a-43a7-b10e-38ccd636832c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:57.426088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-48437434-9a6a-43a7-b10e-38ccd636832c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:57.433420 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-48437434-9a6a-43a7-b10e-38ccd636832c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:57.433884 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-48437434-9a6a-43a7-b10e-38ccd636832c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:57.434714 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-48437434-9a6a-43a7-b10e-38ccd636832c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:57.435159 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-48437434-9a6a-43a7-b10e-38ccd636832c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:57.573696 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-48437434-9a6a-43a7-b10e-38ccd636832c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:57.582413 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-48437434-9a6a-43a7-b10e-38ccd636832c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.162017 Aug 10 05:21:57.583263 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 399/805] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:57 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:58.378090 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:58.378725 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:58.384552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:58.385007 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:58.385764 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:58.386200 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:58.399748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] HTTP exception thrown: Instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b could not be found. Aug 10 05:21:58.400325 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Returning 404 to user: Instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:21:58.401165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-801c4842-f14c-4b73-b89a-93162b9f0834 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 404 len: 111 microversion: 2.1 time: 0.027293 Aug 10 05:21:58.401677 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 407/806] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:58 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:21:58.409602 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e243f42e-dfe9-4106-9e50-5fe041c2eb05 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '.version_select at 0x7fb33c3f30d0>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:58.488936 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e243f42e-dfe9-4106-9e50-5fe041c2eb05 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346428465" status: 202 len: 0 microversion: 2.1 time: 0.082849 Aug 10 05:21:58.489525 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 400/807] 10.222.0.16 () {58 vars in 1221 bytes} [Tue Aug 10 05:21:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346428465 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:21:58.598531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7c1fef74-9776-4a66-833f-dc12237a8462 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:58.599165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7c1fef74-9776-4a66-833f-dc12237a8462 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:58.604906 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c1fef74-9776-4a66-833f-dc12237a8462 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:58.605360 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c1fef74-9776-4a66-833f-dc12237a8462 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:58.606120 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c1fef74-9776-4a66-833f-dc12237a8462 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:58.606556 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c1fef74-9776-4a66-833f-dc12237a8462 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:58.729498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7c1fef74-9776-4a66-833f-dc12237a8462 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:58.748947 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7c1fef74-9776-4a66-833f-dc12237a8462 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.153394 Aug 10 05:21:58.748947 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 408/808] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:58 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:59.765115 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4444b5a9-efb3-4484-bfb7-eb450a5fa17c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:21:59.765731 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4444b5a9-efb3-4484-bfb7-eb450a5fa17c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:59.772219 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4444b5a9-efb3-4484-bfb7-eb450a5fa17c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:59.772677 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4444b5a9-efb3-4484-bfb7-eb450a5fa17c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:59.773450 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4444b5a9-efb3-4484-bfb7-eb450a5fa17c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:59.773894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4444b5a9-efb3-4484-bfb7-eb450a5fa17c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:59.898235 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4444b5a9-efb3-4484-bfb7-eb450a5fa17c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:21:59.908984 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4444b5a9-efb3-4484-bfb7-eb450a5fa17c tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1570 microversion: 2.1 time: 0.147400 Aug 10 05:21:59.909824 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 401/809] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:21:59 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:21:59.925056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-33847ad1-6111-4bd7-89fa-c9901eef27df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:21:59.925612 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-33847ad1-6111-4bd7-89fa-c9901eef27df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:21:59.931531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-33847ad1-6111-4bd7-89fa-c9901eef27df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:59.931978 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-33847ad1-6111-4bd7-89fa-c9901eef27df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:21:59.932740 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-33847ad1-6111-4bd7-89fa-c9901eef27df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:21:59.933173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-33847ad1-6111-4bd7-89fa-c9901eef27df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:00.134142 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-33847ad1-6111-4bd7-89fa-c9901eef27df tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "POST /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8/action" status: 202 len: 0 microversion: 2.1 time: 0.212615 Aug 10 05:22:00.134766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 409/810] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:21:59 2021] POST /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:22:00.142659 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9303f0f3-4eb9-49c1-9e77-b38512cb21bb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:00.143709 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9303f0f3-4eb9-49c1-9e77-b38512cb21bb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:00.149274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9303f0f3-4eb9-49c1-9e77-b38512cb21bb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:00.149720 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9303f0f3-4eb9-49c1-9e77-b38512cb21bb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:00.150496 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9303f0f3-4eb9-49c1-9e77-b38512cb21bb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:00.150958 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9303f0f3-4eb9-49c1-9e77-b38512cb21bb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:00.275048 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9303f0f3-4eb9-49c1-9e77-b38512cb21bb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:00.282609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9303f0f3-4eb9-49c1-9e77-b38512cb21bb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1578 microversion: 2.1 time: 0.143617 Aug 10 05:22:00.283185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 402/811] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:00 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1578 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:00.422213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-732d361e-4cfc-4623-a309-60e66a9618fc req-b23a4f48-0064-4ffb-906f-f3d85cfe0293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766cb709-769b-418b-ad7e-d2360a7f57e8", "name": "network-vif-unplugged", "status": "completed", "tag": "c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:00.424427 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:00.424427 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:22:00.431527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-732d361e-4cfc-4623-a309-60e66a9618fc req-b23a4f48-0064-4ffb-906f-f3d85cfe0293 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:00.431966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-732d361e-4cfc-4623-a309-60e66a9618fc req-b23a4f48-0064-4ffb-906f-f3d85cfe0293 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:00.443346 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.compute.server_external_events [req-732d361e-4cfc-4623-a309-60e66a9618fc req-b23a4f48-0064-4ffb-906f-f3d85cfe0293 service nova] Unable to find a host for instance 766cb709-769b-418b-ad7e-d2360a7f57e8. Dropping event network-vif-unplugged {{(pid=108136) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 10 05:22:00.444250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-732d361e-4cfc-4623-a309-60e66a9618fc req-b23a4f48-0064-4ffb-906f-f3d85cfe0293 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026756 Aug 10 05:22:00.444810 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 410/812] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:00 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 10 05:22:01.306853 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f34a57c7-32d6-4583-b92c-30c123ddf726 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:01.307461 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f34a57c7-32d6-4583-b92c-30c123ddf726 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:01.314115 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f34a57c7-32d6-4583-b92c-30c123ddf726 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:01.314613 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f34a57c7-32d6-4583-b92c-30c123ddf726 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:01.315575 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f34a57c7-32d6-4583-b92c-30c123ddf726 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:01.316394 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f34a57c7-32d6-4583-b92c-30c123ddf726 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:01.441291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f34a57c7-32d6-4583-b92c-30c123ddf726 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:01.448873 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f34a57c7-32d6-4583-b92c-30c123ddf726 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1520 microversion: 2.1 time: 0.145673 Aug 10 05:22:01.449486 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 403/813] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:01 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:01.864117 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:01.864643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:01.870356 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:01.870883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:01.871651 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:01.872082 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:01.885191 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] HTTP exception thrown: Instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b could not be found. Aug 10 05:22:01.885812 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Returning 404 to user: Instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:01.886673 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-92b3f2dc-c766-4c5b-936e-ab6d5af01a11 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 404 len: 111 microversion: 2.1 time: 0.026546 Aug 10 05:22:01.887198 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 411/814] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:22:01 2021] DELETE /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:22:01.895628 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:01.896247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: d0fbeaf1-6c57-45ec-9054-7bd64957f75b] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:01.901882 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:01.902337 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:01.903152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:01.903806 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:01.917349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] HTTP exception thrown: Instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b could not be found. Aug 10 05:22:01.917943 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Returning 404 to user: Instance d0fbeaf1-6c57-45ec-9054-7bd64957f75b could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:01.918805 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cece6568-e3e0-4919-b10d-a916bf7f42d4 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b" status: 404 len: 111 microversion: 2.1 time: 0.026795 Aug 10 05:22:01.919412 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 404/815] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:01 2021] GET /compute/v2.1/servers/d0fbeaf1-6c57-45ec-9054-7bd64957f75b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:22:02.466520 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e31e002b-9390-45d7-a56b-8bca2fe9ec20 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:02.467075 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e31e002b-9390-45d7-a56b-8bca2fe9ec20 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:02.472697 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e31e002b-9390-45d7-a56b-8bca2fe9ec20 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:02.473146 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e31e002b-9390-45d7-a56b-8bca2fe9ec20 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:02.473901 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e31e002b-9390-45d7-a56b-8bca2fe9ec20 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:02.474330 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e31e002b-9390-45d7-a56b-8bca2fe9ec20 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:02.595722 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-e31e002b-9390-45d7-a56b-8bca2fe9ec20 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:02.602985 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e31e002b-9390-45d7-a56b-8bca2fe9ec20 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.140164 Aug 10 05:22:02.603550 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 412/816] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:02 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:03.157722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:03.158233 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:03.163965 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:03.164421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:03.165192 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:03.165629 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:03.179036 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] HTTP exception thrown: Instance 272edeea-3a02-4556-8e12-3a5de760965d could not be found. Aug 10 05:22:03.179666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Returning 404 to user: Instance 272edeea-3a02-4556-8e12-3a5de760965d could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:03.180495 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6c8e0f64-7565-4f65-95a4-28be4ff49256 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "DELETE /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 404 len: 111 microversion: 2.1 time: 0.026544 Aug 10 05:22:03.181030 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 405/817] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:22:03 2021] DELETE /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:22:03.189287 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:03.189899 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] [instance: 272edeea-3a02-4556-8e12-3a5de760965d] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:03.195718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:03.196171 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:03.196946 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:03.197384 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:03.210264 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] HTTP exception thrown: Instance 272edeea-3a02-4556-8e12-3a5de760965d could not be found. Aug 10 05:22:03.210873 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] Returning 404 to user: Instance 272edeea-3a02-4556-8e12-3a5de760965d could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:03.211688 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1f4b6e2b-2ec7-4e7c-9ea8-06ff8c3d9177 tempest-AttachVolumeTestJSON-1986739941 tempest-AttachVolumeTestJSON-1986739941-project] 10.222.0.16 "GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d" status: 404 len: 111 microversion: 2.1 time: 0.026715 Aug 10 05:22:03.212212 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 413/818] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:03 2021] GET /compute/v2.1/servers/272edeea-3a02-4556-8e12-3a5de760965d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:22:03.620564 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6d2d54d0-f3be-40d0-a367-704cf42191ec tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:03.620935 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6d2d54d0-f3be-40d0-a367-704cf42191ec tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:03.626776 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6d2d54d0-f3be-40d0-a367-704cf42191ec tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:03.627225 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6d2d54d0-f3be-40d0-a367-704cf42191ec tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:03.627998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6d2d54d0-f3be-40d0-a367-704cf42191ec tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:03.628430 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6d2d54d0-f3be-40d0-a367-704cf42191ec tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:03.748651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6d2d54d0-f3be-40d0-a367-704cf42191ec tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:03.756059 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6d2d54d0-f3be-40d0-a367-704cf42191ec tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.139448 Aug 10 05:22:03.756628 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 406/819] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:03 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:04.772738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1fcd7a61-d8a6-4afb-b0b8-9676ac85eb6d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:04.773405 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1fcd7a61-d8a6-4afb-b0b8-9676ac85eb6d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:04.779260 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1fcd7a61-d8a6-4afb-b0b8-9676ac85eb6d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:04.779761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1fcd7a61-d8a6-4afb-b0b8-9676ac85eb6d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:04.780543 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1fcd7a61-d8a6-4afb-b0b8-9676ac85eb6d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:04.781195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1fcd7a61-d8a6-4afb-b0b8-9676ac85eb6d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:04.903639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1fcd7a61-d8a6-4afb-b0b8-9676ac85eb6d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:04.911999 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1fcd7a61-d8a6-4afb-b0b8-9676ac85eb6d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.142899 Aug 10 05:22:04.921933 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 414/820] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:04 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:22:05.929078 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-25d43b85-0f1d-47fd-80ef-e358dcd9f2b8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:05.929843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-25d43b85-0f1d-47fd-80ef-e358dcd9f2b8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:05.936027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25d43b85-0f1d-47fd-80ef-e358dcd9f2b8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:05.936476 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25d43b85-0f1d-47fd-80ef-e358dcd9f2b8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:05.937269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25d43b85-0f1d-47fd-80ef-e358dcd9f2b8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:05.938201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25d43b85-0f1d-47fd-80ef-e358dcd9f2b8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:06.117636 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-25d43b85-0f1d-47fd-80ef-e358dcd9f2b8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:06.126247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-25d43b85-0f1d-47fd-80ef-e358dcd9f2b8 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.200767 Aug 10 05:22:06.127484 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 407/821] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:05 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:07.143170 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9b6a448c-b610-4359-832f-1e6e481e531f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:07.143788 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9b6a448c-b610-4359-832f-1e6e481e531f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:07.150124 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9b6a448c-b610-4359-832f-1e6e481e531f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:07.150595 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9b6a448c-b610-4359-832f-1e6e481e531f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:07.151370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9b6a448c-b610-4359-832f-1e6e481e531f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:07.151811 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9b6a448c-b610-4359-832f-1e6e481e531f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:07.272924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9b6a448c-b610-4359-832f-1e6e481e531f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:07.280321 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9b6a448c-b610-4359-832f-1e6e481e531f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.140841 Aug 10 05:22:07.280893 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 415/822] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:07 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:08.297894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f668b2df-a7da-45fb-83b6-e893a999447d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:08.298420 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f668b2df-a7da-45fb-83b6-e893a999447d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:08.304272 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f668b2df-a7da-45fb-83b6-e893a999447d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:08.304718 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f668b2df-a7da-45fb-83b6-e893a999447d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:08.305485 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f668b2df-a7da-45fb-83b6-e893a999447d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:08.305929 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f668b2df-a7da-45fb-83b6-e893a999447d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:08.471941 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f668b2df-a7da-45fb-83b6-e893a999447d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:08.479216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f668b2df-a7da-45fb-83b6-e893a999447d tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.185830 Aug 10 05:22:08.479801 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 408/823] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:08 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:09.495718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8ed2d431-1bb4-4821-9393-e72bd3a10f6b tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:09.501351 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8ed2d431-1bb4-4821-9393-e72bd3a10f6b tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:09.507588 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8ed2d431-1bb4-4821-9393-e72bd3a10f6b tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:09.508121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8ed2d431-1bb4-4821-9393-e72bd3a10f6b tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:09.508976 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8ed2d431-1bb4-4821-9393-e72bd3a10f6b tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:09.509498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8ed2d431-1bb4-4821-9393-e72bd3a10f6b tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:09.642269 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8ed2d431-1bb4-4821-9393-e72bd3a10f6b tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:09.650098 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8ed2d431-1bb4-4821-9393-e72bd3a10f6b tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.157695 Aug 10 05:22:09.659818 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 416/824] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:09 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:09.707325 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-66207877", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "84c8fe6e-fb14-4602-8364-2c50daff5aea"}]}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:09.757266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] validate_networks() for [('84c8fe6e-fb14-4602-8364-2c50daff5aea', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:22:10.131333 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:22:10.131753 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:22:10.132360 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:22:10.132803 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:22:10.133228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:22:10.141972 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:10.142421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:10.143279 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:10.143821 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:10.161158 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Getting quotas for project 9c1e88b565f34674a368e054f0a19cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:22:10.165038 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Getting quotas for user 7021089fd78c4c70b303877e71bc6215 and project 9c1e88b565f34674a368e054f0a19cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:22:10.176367 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:22:10.178698 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:22:10.276103 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-287b6e63-fcd7-4fae-8fa1-160354da3fc3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691659 Aug 10 05:22:10.276742 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 409/825] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:22:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 05:22:10.287593 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-261b1527-3433-4b1b-bc6f-2f0c335f97d6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:10.288687 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-261b1527-3433-4b1b-bc6f-2f0c335f97d6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:10.340297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-261b1527-3433-4b1b-bc6f-2f0c335f97d6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:10.347202 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-261b1527-3433-4b1b-bc6f-2f0c335f97d6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1216 microversion: 2.1 time: 0.063673 Aug 10 05:22:10.347912 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 417/826] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:10 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1216 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:10.666558 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1f2ba9e4-0a2a-4445-a1a8-179d8dc8d0c9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:10.667122 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1f2ba9e4-0a2a-4445-a1a8-179d8dc8d0c9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:10.673043 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1f2ba9e4-0a2a-4445-a1a8-179d8dc8d0c9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:10.673498 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1f2ba9e4-0a2a-4445-a1a8-179d8dc8d0c9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:10.674267 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1f2ba9e4-0a2a-4445-a1a8-179d8dc8d0c9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:10.674735 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1f2ba9e4-0a2a-4445-a1a8-179d8dc8d0c9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:10.799975 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1f2ba9e4-0a2a-4445-a1a8-179d8dc8d0c9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:10.807308 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1f2ba9e4-0a2a-4445-a1a8-179d8dc8d0c9 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.144491 Aug 10 05:22:10.808014 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 410/827] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:10 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:11.363774 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a0d83980-e566-4c5b-9adb-56ba2c8b7d44 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:11.364381 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a0d83980-e566-4c5b-9adb-56ba2c8b7d44 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:11.370375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a0d83980-e566-4c5b-9adb-56ba2c8b7d44 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:11.370968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a0d83980-e566-4c5b-9adb-56ba2c8b7d44 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:11.371742 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a0d83980-e566-4c5b-9adb-56ba2c8b7d44 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:11.372190 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a0d83980-e566-4c5b-9adb-56ba2c8b7d44 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:11.429235 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a0d83980-e566-4c5b-9adb-56ba2c8b7d44 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:11.436443 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a0d83980-e566-4c5b-9adb-56ba2c8b7d44 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1220 microversion: 2.1 time: 0.077313 Aug 10 05:22:11.437005 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 418/828] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:11 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:11.823576 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-04c52f5b-52b8-4a9b-984d-b3b3200721e0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:11.824257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-04c52f5b-52b8-4a9b-984d-b3b3200721e0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:11.830445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-04c52f5b-52b8-4a9b-984d-b3b3200721e0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:11.830920 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-04c52f5b-52b8-4a9b-984d-b3b3200721e0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:11.831719 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-04c52f5b-52b8-4a9b-984d-b3b3200721e0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:11.832149 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-04c52f5b-52b8-4a9b-984d-b3b3200721e0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:11.950625 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-04c52f5b-52b8-4a9b-984d-b3b3200721e0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:11.958431 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-04c52f5b-52b8-4a9b-984d-b3b3200721e0 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.138644 Aug 10 05:22:11.959108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 411/829] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:11 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:12.453552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5f7cbbe1-27d3-40f4-9ba5-2624251e2fdc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:12.454167 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5f7cbbe1-27d3-40f4-9ba5-2624251e2fdc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:12.461319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5f7cbbe1-27d3-40f4-9ba5-2624251e2fdc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:12.462452 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5f7cbbe1-27d3-40f4-9ba5-2624251e2fdc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:12.463431 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5f7cbbe1-27d3-40f4-9ba5-2624251e2fdc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:12.464505 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5f7cbbe1-27d3-40f4-9ba5-2624251e2fdc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:12.551108 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5f7cbbe1-27d3-40f4-9ba5-2624251e2fdc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:12.559174 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5f7cbbe1-27d3-40f4-9ba5-2624251e2fdc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1276 microversion: 2.1 time: 0.109600 Aug 10 05:22:12.559764 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 419/830] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:12 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:12.976009 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f02f9aa6-2ef0-4759-b76e-0ff32a288553 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:12.976632 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f02f9aa6-2ef0-4759-b76e-0ff32a288553 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:12.982505 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f02f9aa6-2ef0-4759-b76e-0ff32a288553 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:12.982997 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f02f9aa6-2ef0-4759-b76e-0ff32a288553 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:12.983787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f02f9aa6-2ef0-4759-b76e-0ff32a288553 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:12.990247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f02f9aa6-2ef0-4759-b76e-0ff32a288553 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:13.127331 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f02f9aa6-2ef0-4759-b76e-0ff32a288553 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:13.135609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f02f9aa6-2ef0-4759-b76e-0ff32a288553 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.163531 Aug 10 05:22:13.145728 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 412/831] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:12 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:13.576766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-475e0e53-d3e9-4594-8938-3bfe2fd456fa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:13.577376 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-475e0e53-d3e9-4594-8938-3bfe2fd456fa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:13.583343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-475e0e53-d3e9-4594-8938-3bfe2fd456fa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:13.583787 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-475e0e53-d3e9-4594-8938-3bfe2fd456fa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:13.584553 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-475e0e53-d3e9-4594-8938-3bfe2fd456fa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:13.584980 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-475e0e53-d3e9-4594-8938-3bfe2fd456fa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:13.819687 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-475e0e53-d3e9-4594-8938-3bfe2fd456fa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:13.828638 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-475e0e53-d3e9-4594-8938-3bfe2fd456fa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1316 microversion: 2.1 time: 0.255317 Aug 10 05:22:13.829630 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 420/832] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:13 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:14.151828 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d16950bd-bbf2-40be-b429-ddf465890ee3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:14.152449 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d16950bd-bbf2-40be-b429-ddf465890ee3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:14.158328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d16950bd-bbf2-40be-b429-ddf465890ee3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:14.159393 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d16950bd-bbf2-40be-b429-ddf465890ee3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:14.165160 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d16950bd-bbf2-40be-b429-ddf465890ee3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:14.165160 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d16950bd-bbf2-40be-b429-ddf465890ee3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:14.286961 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d16950bd-bbf2-40be-b429-ddf465890ee3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:14.291884 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d16950bd-bbf2-40be-b429-ddf465890ee3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.143752 Aug 10 05:22:14.292839 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 413/833] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:14 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:14.336064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-5d05886a-a8c0-4add-892d-e7e81f08a401 req-f76234fd-96e5-418f-b615-8f37b39dd355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5", "tag": "8ddaee6c-67a4-46bd-a614-ad1bb584f581"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:14.338093 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:14.338093 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:22:14.345325 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-5d05886a-a8c0-4add-892d-e7e81f08a401 req-f76234fd-96e5-418f-b615-8f37b39dd355 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:14.345764 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-5d05886a-a8c0-4add-892d-e7e81f08a401 req-f76234fd-96e5-418f-b615-8f37b39dd355 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:14.358771 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-5d05886a-a8c0-4add-892d-e7e81f08a401 req-f76234fd-96e5-418f-b615-8f37b39dd355 service nova] Creating event network-changed:8ddaee6c-67a4-46bd-a614-ad1bb584f581 for instance 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 on hv-cinder-80390 Aug 10 05:22:14.364966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-5d05886a-a8c0-4add-892d-e7e81f08a401 req-f76234fd-96e5-418f-b615-8f37b39dd355 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104792 Aug 10 05:22:14.365678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 421/834] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:22:14.501922 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-709fb34d-70f7-436a-a6a7-75705c86678c req-42848531-47f6-498b-b2e6-a274e293f80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766cb709-769b-418b-ad7e-d2360a7f57e8", "name": "network-vif-plugged", "status": "completed", "tag": "c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:14.503559 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:14.503559 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:22:14.510325 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-709fb34d-70f7-436a-a6a7-75705c86678c req-42848531-47f6-498b-b2e6-a274e293f80f service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:14.510736 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-709fb34d-70f7-436a-a6a7-75705c86678c req-42848531-47f6-498b-b2e6-a274e293f80f service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:14.522150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-709fb34d-70f7-436a-a6a7-75705c86678c req-42848531-47f6-498b-b2e6-a274e293f80f service nova] Creating event network-vif-plugged:c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154 for instance 766cb709-769b-418b-ad7e-d2360a7f57e8 on hv-cinder-80390 Aug 10 05:22:14.527896 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-709fb34d-70f7-436a-a6a7-75705c86678c req-42848531-47f6-498b-b2e6-a274e293f80f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029554 Aug 10 05:22:14.528876 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 414/835] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:22:14.845547 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-231e5773-28a0-4153-9173-9a3d77e4213a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:14.846803 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-231e5773-28a0-4153-9173-9a3d77e4213a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:14.852994 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-231e5773-28a0-4153-9173-9a3d77e4213a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:14.853448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-231e5773-28a0-4153-9173-9a3d77e4213a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:14.854228 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-231e5773-28a0-4153-9173-9a3d77e4213a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:14.854693 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-231e5773-28a0-4153-9173-9a3d77e4213a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:14.973501 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-231e5773-28a0-4153-9173-9a3d77e4213a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:14.980701 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-231e5773-28a0-4153-9173-9a3d77e4213a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1316 microversion: 2.1 time: 0.139145 Aug 10 05:22:14.981339 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 422/836] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:14 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:15.309612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ac677da8-25a3-4ee0-a1b4-97d3975bedf3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:15.310317 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ac677da8-25a3-4ee0-a1b4-97d3975bedf3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:15.316564 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac677da8-25a3-4ee0-a1b4-97d3975bedf3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:15.317016 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac677da8-25a3-4ee0-a1b4-97d3975bedf3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:15.317795 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac677da8-25a3-4ee0-a1b4-97d3975bedf3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:15.318234 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac677da8-25a3-4ee0-a1b4-97d3975bedf3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:15.440770 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ac677da8-25a3-4ee0-a1b4-97d3975bedf3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:15.448155 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ac677da8-25a3-4ee0-a1b4-97d3975bedf3 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1576 microversion: 2.1 time: 0.142635 Aug 10 05:22:15.448720 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 415/837] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:15 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1576 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:15.998373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3fd539d6-ef29-4e49-8a8e-26358a383eb2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:15.999007 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3fd539d6-ef29-4e49-8a8e-26358a383eb2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:16.005889 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fd539d6-ef29-4e49-8a8e-26358a383eb2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:16.006345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fd539d6-ef29-4e49-8a8e-26358a383eb2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:16.007162 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fd539d6-ef29-4e49-8a8e-26358a383eb2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:16.007607 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3fd539d6-ef29-4e49-8a8e-26358a383eb2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:16.161594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3fd539d6-ef29-4e49-8a8e-26358a383eb2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:16.161594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3fd539d6-ef29-4e49-8a8e-26358a383eb2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1316 microversion: 2.1 time: 0.152899 Aug 10 05:22:16.161594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 423/838] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:15 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:16.465308 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-132a58bf-4965-4f3e-8695-114402e4d47f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:16.465867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-132a58bf-4965-4f3e-8695-114402e4d47f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:16.471913 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-132a58bf-4965-4f3e-8695-114402e4d47f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:16.472361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-132a58bf-4965-4f3e-8695-114402e4d47f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:16.473112 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-132a58bf-4965-4f3e-8695-114402e4d47f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:16.473545 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-132a58bf-4965-4f3e-8695-114402e4d47f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:16.590536 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-132a58bf-4965-4f3e-8695-114402e4d47f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:16.598116 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-132a58bf-4965-4f3e-8695-114402e4d47f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1563 microversion: 2.1 time: 0.136586 Aug 10 05:22:16.598689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 416/839] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:16 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1563 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:17.168876 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5673f6dc-a1b4-44c8-b93f-4b637254f03c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:17.169487 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5673f6dc-a1b4-44c8-b93f-4b637254f03c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:17.175993 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5673f6dc-a1b4-44c8-b93f-4b637254f03c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:17.176442 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5673f6dc-a1b4-44c8-b93f-4b637254f03c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:17.177206 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5673f6dc-a1b4-44c8-b93f-4b637254f03c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:17.177643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5673f6dc-a1b4-44c8-b93f-4b637254f03c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:17.294360 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5673f6dc-a1b4-44c8-b93f-4b637254f03c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:17.301573 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5673f6dc-a1b4-44c8-b93f-4b637254f03c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1316 microversion: 2.1 time: 0.136390 Aug 10 05:22:17.302134 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 424/840] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:17 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1316 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:18.318651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8a553713-e937-428f-916b-b005d5f5ca62 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:18.319234 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8a553713-e937-428f-916b-b005d5f5ca62 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:18.325039 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8a553713-e937-428f-916b-b005d5f5ca62 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:18.325483 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8a553713-e937-428f-916b-b005d5f5ca62 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:18.326243 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8a553713-e937-428f-916b-b005d5f5ca62 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:18.326696 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8a553713-e937-428f-916b-b005d5f5ca62 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:18.442535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8a553713-e937-428f-916b-b005d5f5ca62 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:18.449711 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8a553713-e937-428f-916b-b005d5f5ca62 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1316 microversion: 2.1 time: 0.135318 Aug 10 05:22:18.450278 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 417/841] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:18 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1316 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:19.465437 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e05b9d77-9992-48b1-aaf1-4bcd8e65290e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:19.466044 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e05b9d77-9992-48b1-aaf1-4bcd8e65290e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:19.472426 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e05b9d77-9992-48b1-aaf1-4bcd8e65290e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:19.472887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e05b9d77-9992-48b1-aaf1-4bcd8e65290e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:19.473644 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e05b9d77-9992-48b1-aaf1-4bcd8e65290e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:19.474084 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e05b9d77-9992-48b1-aaf1-4bcd8e65290e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:19.590266 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-e05b9d77-9992-48b1-aaf1-4bcd8e65290e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:19.598049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e05b9d77-9992-48b1-aaf1-4bcd8e65290e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1316 microversion: 2.1 time: 0.136226 Aug 10 05:22:19.598648 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 425/842] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:19 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1316 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:20.615377 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b96c63e8-5873-49ce-9976-5d2205007a28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:20.615990 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b96c63e8-5873-49ce-9976-5d2205007a28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:20.621779 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b96c63e8-5873-49ce-9976-5d2205007a28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:20.622229 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b96c63e8-5873-49ce-9976-5d2205007a28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:20.623021 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b96c63e8-5873-49ce-9976-5d2205007a28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:20.623452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b96c63e8-5873-49ce-9976-5d2205007a28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:20.624459 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-00bcbec1-d7cf-4b70-9311-9f5542ce88c6 req-2c96ee23-44a8-45ee-91e7-37e2f0249a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5", "name": "network-vif-plugged", "status": "completed", "tag": "8ddaee6c-67a4-46bd-a614-ad1bb584f581"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:20.626680 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:20.626680 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:22:20.634386 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-00bcbec1-d7cf-4b70-9311-9f5542ce88c6 req-2c96ee23-44a8-45ee-91e7-37e2f0249a00 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:20.634386 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-00bcbec1-d7cf-4b70-9311-9f5542ce88c6 req-2c96ee23-44a8-45ee-91e7-37e2f0249a00 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:20.645334 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-00bcbec1-d7cf-4b70-9311-9f5542ce88c6 req-2c96ee23-44a8-45ee-91e7-37e2f0249a00 service nova] Creating event network-vif-plugged:8ddaee6c-67a4-46bd-a614-ad1bb584f581 for instance 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 on hv-cinder-80390 Aug 10 05:22:20.650167 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-00bcbec1-d7cf-4b70-9311-9f5542ce88c6 req-2c96ee23-44a8-45ee-91e7-37e2f0249a00 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029827 Aug 10 05:22:20.650980 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 426/843] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:22:20.748508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b96c63e8-5873-49ce-9976-5d2205007a28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:20.755764 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b96c63e8-5873-49ce-9976-5d2205007a28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1316 microversion: 2.1 time: 0.144989 Aug 10 05:22:20.757373 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 418/844] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:20 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1316 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:21.772711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-efef2952-4399-4aa1-b5b3-b9aa0603908c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:21.773426 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-efef2952-4399-4aa1-b5b3-b9aa0603908c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:21.779648 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-efef2952-4399-4aa1-b5b3-b9aa0603908c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:21.780033 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-efef2952-4399-4aa1-b5b3-b9aa0603908c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:21.780809 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-efef2952-4399-4aa1-b5b3-b9aa0603908c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:21.781249 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-efef2952-4399-4aa1-b5b3-b9aa0603908c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:21.902230 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-efef2952-4399-4aa1-b5b3-b9aa0603908c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:21.909398 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-efef2952-4399-4aa1-b5b3-b9aa0603908c tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1316 microversion: 2.1 time: 0.140724 Aug 10 05:22:21.909958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 427/845] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:21 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1316 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:22.926515 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-43699262-835f-411c-aeb1-58e8704d6394 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:22.927168 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-43699262-835f-411c-aeb1-58e8704d6394 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:22.933132 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-43699262-835f-411c-aeb1-58e8704d6394 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:22.933586 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-43699262-835f-411c-aeb1-58e8704d6394 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:22.939561 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-43699262-835f-411c-aeb1-58e8704d6394 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:22.939561 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-43699262-835f-411c-aeb1-58e8704d6394 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:23.054094 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-43699262-835f-411c-aeb1-58e8704d6394 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:23.061438 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-43699262-835f-411c-aeb1-58e8704d6394 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1505 microversion: 2.1 time: 0.139271 Aug 10 05:22:23.062005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 419/846] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:22 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1505 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:24.823555 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-41ff5410-84f9-49c7-8547-e43eb3311de4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1891facb-c968-4e58-bde9-1ddd0ae380c5"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:24.824633 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-41ff5410-84f9-49c7-8547-e43eb3311de4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:24.830338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-41ff5410-84f9-49c7-8547-e43eb3311de4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:24.831303 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-41ff5410-84f9-49c7-8547-e43eb3311de4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:24.832085 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-41ff5410-84f9-49c7-8547-e43eb3311de4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:24.832518 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-41ff5410-84f9-49c7-8547-e43eb3311de4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:25.490764 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-41ff5410-84f9-49c7-8547-e43eb3311de4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670917 Aug 10 05:22:25.491360 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 428/847] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:22:24 2021] POST /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:22:28.407786 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-dd3b0d49-b17a-45f4-8bde-3e4745d26aa4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:28.408700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-dd3b0d49-b17a-45f4-8bde-3e4745d26aa4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:28.414565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dd3b0d49-b17a-45f4-8bde-3e4745d26aa4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:28.415057 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dd3b0d49-b17a-45f4-8bde-3e4745d26aa4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:28.415825 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dd3b0d49-b17a-45f4-8bde-3e4745d26aa4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:28.416262 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dd3b0d49-b17a-45f4-8bde-3e4745d26aa4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:28.445128 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-dd3b0d49-b17a-45f4-8bde-3e4745d26aa4 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041104 Aug 10 05:22:28.445668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 420/848] 10.222.0.16 () {60 vars in 1343 bytes} [Tue Aug 10 05:22:28 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:28.505382 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a45112e8-e4c6-4672-99be-9c3485c4e487 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:28.505966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a45112e8-e4c6-4672-99be-9c3485c4e487 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:28.512725 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a45112e8-e4c6-4672-99be-9c3485c4e487 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:28.513183 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a45112e8-e4c6-4672-99be-9c3485c4e487 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:28.513940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a45112e8-e4c6-4672-99be-9c3485c4e487 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:28.514377 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a45112e8-e4c6-4672-99be-9c3485c4e487 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:28.538058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a45112e8-e4c6-4672-99be-9c3485c4e487 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:22:28.766060 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a45112e8-e4c6-4672-99be-9c3485c4e487 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 204 len: 0 microversion: 2.20 time: 0.265559 Aug 10 05:22:28.766770 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 429/849] 10.222.0.16 () {60 vars in 1280 bytes} [Tue Aug 10 05:22:28 2021] DELETE /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 05:22:28.774722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:28.775353 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:28.781156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:28.781603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:28.782355 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:28.782821 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:28.900995 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:28.908800 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:28.910913 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:28.912054 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-80e6c646-99ce-4bf1-8368-16ba2af140cd tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.141018 Aug 10 05:22:28.912616 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 421/850] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:22:28 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 05:22:29.930851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:29.931471 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:29.937297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:29.937740 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:29.938492 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:29.938955 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:30.057376 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:30.064985 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:30.067092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:30.068207 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-02e20ddf-7cee-49bb-a5dd-8148a2096e7c tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1724 microversion: 2.20 time: 0.141517 Aug 10 05:22:30.068756 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 430/851] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:22:29 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:22:31.086567 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:31.087197 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:31.093506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:31.093956 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:31.094766 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:31.095211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:31.343462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:31.352340 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:31.353880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:31.355116 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-081b13c5-7fcb-47c8-93e0-fffb2b695e1d tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1656 microversion: 2.20 time: 0.272985 Aug 10 05:22:31.355675 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 422/852] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:22:31 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1656 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:22:31.414299 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-fac1b702-81c1-456b-839d-449d90cee4ff req-c731f7d2-081c-441d-9040-53ec23852bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef", "name": "network-vif-deleted", "tag": "e218a600-deee-4780-bff5-a3a5af129359"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:31.416639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:31.416639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:22:31.423697 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-fac1b702-81c1-456b-839d-449d90cee4ff req-c731f7d2-081c-441d-9040-53ec23852bf0 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:31.424141 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-fac1b702-81c1-456b-839d-449d90cee4ff req-c731f7d2-081c-441d-9040-53ec23852bf0 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:31.435596 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-fac1b702-81c1-456b-839d-449d90cee4ff req-c731f7d2-081c-441d-9040-53ec23852bf0 service nova] Creating event network-vif-deleted:e218a600-deee-4780-bff5-a3a5af129359 for instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef on hv-cinder-80390 Aug 10 05:22:31.440547 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-fac1b702-81c1-456b-839d-449d90cee4ff req-c731f7d2-081c-441d-9040-53ec23852bf0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029937 Aug 10 05:22:31.441146 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 431/853] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:22:32.373269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:32.373796 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:32.379855 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:32.380312 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:32.381072 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:32.381526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:32.414635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:32.415221 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:32.415679 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lazy-loading 'fault' on Instance uuid 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:22:32.454342 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:32.462951 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:32.464444 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'af5ad45d471648a487e5c95cb63163e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bebe35ab6ed44b49537caff8aaa8562', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:32.465687 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-788200cc-c951-4051-bc4d-82375fe5a403 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 200 len: 1371 microversion: 2.20 time: 0.096307 Aug 10 05:22:32.466242 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 423/854] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:22:32 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 1371 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 05:22:33.038209 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-193761610", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "84c8fe6e-fb14-4602-8364-2c50daff5aea"}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:33.087739 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] validate_networks() for [('84c8fe6e-fb14-4602-8364-2c50daff5aea', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:22:33.479123 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:22:33.479646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:22:33.480063 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:22:33.480509 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:22:33.480928 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:22:33.484318 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:33.484926 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:33.491250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:33.491698 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:33.491827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:33.492151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:33.492507 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:33.492917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:33.493032 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:33.493357 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:33.506294 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] HTTP exception thrown: Instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef could not be found. Aug 10 05:22:33.506909 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Returning 404 to user: Instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:33.507742 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d6cf325e-e9b6-4ff8-a37f-606f486a5d76 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 404 len: 111 microversion: 2.20 time: 0.027063 Aug 10 05:22:33.508280 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 424/855] 10.222.0.16 () {60 vars in 1277 bytes} [Tue Aug 10 05:22:33 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 05:22:33.509244 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Getting quotas for project 9c1e88b565f34674a368e054f0a19cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:22:33.513320 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Getting quotas for user 7021089fd78c4c70b303877e71bc6215 and project 9c1e88b565f34674a368e054f0a19cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:22:33.516529 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7ce57662-5707-4e65-a2bd-16d59a06add8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '.version_select at 0x7fb33d07c430>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:33.524537 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:22:33.526996 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:22:33.624620 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7ce57662-5707-4e65-a2bd-16d59a06add8 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259055978" status: 204 len: 0 microversion: 2.20 time: 0.111625 Aug 10 05:22:33.625219 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 425/856] 10.222.0.16 () {60 vars in 1262 bytes} [Tue Aug 10 05:22:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259055978 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 05:22:33.665718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b9946c08-e157-4ec5-8025-051b82675aca tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632117 Aug 10 05:22:33.671228 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 432/857] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:22:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:22:33.684963 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-df3f45ec-0434-4bf4-a386-6de10ca07bb6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:33.685069 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-df3f45ec-0434-4bf4-a386-6de10ca07bb6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:33.742947 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-df3f45ec-0434-4bf4-a386-6de10ca07bb6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:33.750661 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-df3f45ec-0434-4bf4-a386-6de10ca07bb6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1217 microversion: 2.1 time: 0.069734 Aug 10 05:22:33.751246 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 426/858] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:33 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:34.766446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2b5fc9eb-4ac5-4d41-97d7-11c3774a313a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:34.767018 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2b5fc9eb-4ac5-4d41-97d7-11c3774a313a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:34.773713 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9eb-4ac5-4d41-97d7-11c3774a313a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:34.778914 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9eb-4ac5-4d41-97d7-11c3774a313a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:34.778914 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9eb-4ac5-4d41-97d7-11c3774a313a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:34.778914 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b5fc9eb-4ac5-4d41-97d7-11c3774a313a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:34.833738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2b5fc9eb-4ac5-4d41-97d7-11c3774a313a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:34.840957 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2b5fc9eb-4ac5-4d41-97d7-11c3774a313a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1221 microversion: 2.1 time: 0.078268 Aug 10 05:22:34.841515 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 433/859] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:34 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:35.663818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:35.664324 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:35.670063 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:35.670732 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:35.671514 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:35.671954 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:35.685239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] HTTP exception thrown: Instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef could not be found. Aug 10 05:22:35.685824 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Returning 404 to user: Instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:35.686678 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5efeaa25-1d9a-42bc-a56e-85238e5a34a9 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 404 len: 111 microversion: 2.1 time: 0.026597 Aug 10 05:22:35.687210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 427/860] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:22:35 2021] DELETE /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:22:35.695611 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:35.696223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:35.702470 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:35.702950 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:35.703733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:35.704165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:35.717329 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] HTTP exception thrown: Instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef could not be found. Aug 10 05:22:35.717903 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Returning 404 to user: Instance 4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:35.718768 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4d656eb5-d5cc-4642-8b97-df8cebbff63b tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef" status: 404 len: 111 microversion: 2.1 time: 0.027353 Aug 10 05:22:35.719277 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 434/861] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:35 2021] GET /compute/v2.1/servers/4c2e82bf-04e2-493f-9d6e-5243aa3ab9ef => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:22:35.858032 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-23f1893c-f03c-4d55-b5de-62ebf41b106f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:35.858866 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-23f1893c-f03c-4d55-b5de-62ebf41b106f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:35.866260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-23f1893c-f03c-4d55-b5de-62ebf41b106f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:35.866743 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-23f1893c-f03c-4d55-b5de-62ebf41b106f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:35.867682 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-23f1893c-f03c-4d55-b5de-62ebf41b106f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:35.868229 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-23f1893c-f03c-4d55-b5de-62ebf41b106f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:35.942880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-23f1893c-f03c-4d55-b5de-62ebf41b106f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:35.951637 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-23f1893c-f03c-4d55-b5de-62ebf41b106f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1275 microversion: 2.1 time: 0.097226 Aug 10 05:22:35.952526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 428/862] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:35 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1275 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:36.977490 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c00c4c19-329f-42c7-8e08-109b837e77bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:36.978101 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c00c4c19-329f-42c7-8e08-109b837e77bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:36.986764 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c00c4c19-329f-42c7-8e08-109b837e77bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:36.987236 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c00c4c19-329f-42c7-8e08-109b837e77bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:36.987994 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c00c4c19-329f-42c7-8e08-109b837e77bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:36.988275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:36.988714 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c00c4c19-329f-42c7-8e08-109b837e77bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:36.988820 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:36.994477 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:36.997798 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:36.997798 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:36.997798 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:37.009755 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] HTTP exception thrown: Instance 125a0f58-1cac-47b7-8486-e02530bcfb8f could not be found. Aug 10 05:22:37.010342 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Returning 404 to user: Instance 125a0f58-1cac-47b7-8486-e02530bcfb8f could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:37.011199 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d2a39194-92f9-4dad-97e6-7a1a54bb2d25 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "DELETE /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 404 len: 111 microversion: 2.1 time: 0.026988 Aug 10 05:22:37.011733 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 429/863] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:22:36 2021] DELETE /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:22:37.019041 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:37.019646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] [instance: 125a0f58-1cac-47b7-8486-e02530bcfb8f] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:37.032543 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:37.032543 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:37.032543 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:37.032543 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:37.041637 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] HTTP exception thrown: Instance 125a0f58-1cac-47b7-8486-e02530bcfb8f could not be found. Aug 10 05:22:37.042225 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] Returning 404 to user: Instance 125a0f58-1cac-47b7-8486-e02530bcfb8f could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:37.043082 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7366290c-001b-4b60-a34e-affc19e7cfe6 tempest-AttachVolumeShelveTestJSON-1524334433 tempest-AttachVolumeShelveTestJSON-1524334433-project] 10.222.0.16 "GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f" status: 404 len: 111 microversion: 2.1 time: 0.027357 Aug 10 05:22:37.043619 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 430/864] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:37 2021] GET /compute/v2.1/servers/125a0f58-1cac-47b7-8486-e02530bcfb8f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:22:37.105864 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-3eeba979-310a-4285-bb65-5dce1e52b8f4 req-314ce070-d7fe-4510-967d-029a79ff38b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "675cc748-f393-42c3-a063-f7fa2547a2e0", "tag": "a29b4f8f-eb94-4996-a605-788549f47ee7"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:37.107561 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:37.107561 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:22:37.116018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-3eeba979-310a-4285-bb65-5dce1e52b8f4 req-314ce070-d7fe-4510-967d-029a79ff38b3 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:37.116159 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-3eeba979-310a-4285-bb65-5dce1e52b8f4 req-314ce070-d7fe-4510-967d-029a79ff38b3 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:37.127893 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-3eeba979-310a-4285-bb65-5dce1e52b8f4 req-314ce070-d7fe-4510-967d-029a79ff38b3 service nova] Creating event network-changed:a29b4f8f-eb94-4996-a605-788549f47ee7 for instance 675cc748-f393-42c3-a063-f7fa2547a2e0 on hv-cinder-80390 Aug 10 05:22:37.133216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-3eeba979-310a-4285-bb65-5dce1e52b8f4 req-314ce070-d7fe-4510-967d-029a79ff38b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032282 Aug 10 05:22:37.133978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 431/865] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:22:37.180527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c00c4c19-329f-42c7-8e08-109b837e77bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:37.188143 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c00c4c19-329f-42c7-8e08-109b837e77bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1317 microversion: 2.1 time: 0.214874 Aug 10 05:22:37.189245 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 435/866] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:36 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:38.205657 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bbf65f51-ac62-42da-bf5a-51c4ef7097ed tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:38.206762 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bbf65f51-ac62-42da-bf5a-51c4ef7097ed tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:38.213415 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bbf65f51-ac62-42da-bf5a-51c4ef7097ed tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:38.214005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bbf65f51-ac62-42da-bf5a-51c4ef7097ed tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:38.214928 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bbf65f51-ac62-42da-bf5a-51c4ef7097ed tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:38.215495 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bbf65f51-ac62-42da-bf5a-51c4ef7097ed tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:38.339382 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-bbf65f51-ac62-42da-bf5a-51c4ef7097ed tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:38.346499 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bbf65f51-ac62-42da-bf5a-51c4ef7097ed tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1317 microversion: 2.1 time: 0.144927 Aug 10 05:22:38.347093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 432/867] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:38 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:39.363953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2dc57a30-1225-497e-b48f-a60dd6cf3c28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:39.364662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2dc57a30-1225-497e-b48f-a60dd6cf3c28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:39.370431 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2dc57a30-1225-497e-b48f-a60dd6cf3c28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:39.370909 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2dc57a30-1225-497e-b48f-a60dd6cf3c28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:39.371678 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2dc57a30-1225-497e-b48f-a60dd6cf3c28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:39.372114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2dc57a30-1225-497e-b48f-a60dd6cf3c28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:39.521608 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2dc57a30-1225-497e-b48f-a60dd6cf3c28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:39.536822 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2dc57a30-1225-497e-b48f-a60dd6cf3c28 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1317 microversion: 2.1 time: 0.176834 Aug 10 05:22:39.543041 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 436/868] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:39 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:40.553840 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c831a31f-ef0a-4cc4-b207-9ab44ba179f6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:40.554454 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c831a31f-ef0a-4cc4-b207-9ab44ba179f6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:40.560267 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c831a31f-ef0a-4cc4-b207-9ab44ba179f6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:40.561114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c831a31f-ef0a-4cc4-b207-9ab44ba179f6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:40.562180 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c831a31f-ef0a-4cc4-b207-9ab44ba179f6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:40.562699 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c831a31f-ef0a-4cc4-b207-9ab44ba179f6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:40.693728 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c831a31f-ef0a-4cc4-b207-9ab44ba179f6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:40.701514 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c831a31f-ef0a-4cc4-b207-9ab44ba179f6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1317 microversion: 2.1 time: 0.151928 Aug 10 05:22:40.702432 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 433/869] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:40 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:41.718002 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-42505ab2-c181-42d8-9e33-9db0d1a871e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:41.718780 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-42505ab2-c181-42d8-9e33-9db0d1a871e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:41.724634 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-42505ab2-c181-42d8-9e33-9db0d1a871e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:41.725089 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-42505ab2-c181-42d8-9e33-9db0d1a871e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:41.725948 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-42505ab2-c181-42d8-9e33-9db0d1a871e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:41.726389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-42505ab2-c181-42d8-9e33-9db0d1a871e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:41.844881 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-42505ab2-c181-42d8-9e33-9db0d1a871e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:41.854035 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-42505ab2-c181-42d8-9e33-9db0d1a871e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1317 microversion: 2.1 time: 0.138197 Aug 10 05:22:41.854035 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 437/870] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:41 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:42.759189 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-6ff0432c-fb4c-4a4f-bd47-cc1e87cd8480 req-a2c92a24-7e4b-4815-94ee-1691c46fb245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675cc748-f393-42c3-a063-f7fa2547a2e0", "name": "network-vif-plugged", "status": "completed", "tag": "a29b4f8f-eb94-4996-a605-788549f47ee7"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:42.760811 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:42.760811 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:22:42.767733 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-6ff0432c-fb4c-4a4f-bd47-cc1e87cd8480 req-a2c92a24-7e4b-4815-94ee-1691c46fb245 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:42.768183 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-6ff0432c-fb4c-4a4f-bd47-cc1e87cd8480 req-a2c92a24-7e4b-4815-94ee-1691c46fb245 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:42.779313 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-6ff0432c-fb4c-4a4f-bd47-cc1e87cd8480 req-a2c92a24-7e4b-4815-94ee-1691c46fb245 service nova] Creating event network-vif-plugged:a29b4f8f-eb94-4996-a605-788549f47ee7 for instance 675cc748-f393-42c3-a063-f7fa2547a2e0 on hv-cinder-80390 Aug 10 05:22:42.783834 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-6ff0432c-fb4c-4a4f-bd47-cc1e87cd8480 req-a2c92a24-7e4b-4815-94ee-1691c46fb245 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028342 Aug 10 05:22:42.784403 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 434/871] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:22:42.869270 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d9598977-5927-409e-9e79-763d7da22ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:42.870154 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d9598977-5927-409e-9e79-763d7da22ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:42.876197 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d9598977-5927-409e-9e79-763d7da22ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:42.876645 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d9598977-5927-409e-9e79-763d7da22ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:42.877604 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d9598977-5927-409e-9e79-763d7da22ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:42.878209 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d9598977-5927-409e-9e79-763d7da22ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:43.012958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d9598977-5927-409e-9e79-763d7da22ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:43.021255 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d9598977-5927-409e-9e79-763d7da22ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1317 microversion: 2.1 time: 0.155708 Aug 10 05:22:43.021821 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 438/872] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:42 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:44.038359 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0a0735ae-b4fb-404d-aaab-1d3b2afde8b3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:44.039252 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0a0735ae-b4fb-404d-aaab-1d3b2afde8b3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:44.045239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a0735ae-b4fb-404d-aaab-1d3b2afde8b3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:44.045681 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a0735ae-b4fb-404d-aaab-1d3b2afde8b3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:44.046455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a0735ae-b4fb-404d-aaab-1d3b2afde8b3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:44.046917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0a0735ae-b4fb-404d-aaab-1d3b2afde8b3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:44.175553 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0a0735ae-b4fb-404d-aaab-1d3b2afde8b3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:44.183556 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0a0735ae-b4fb-404d-aaab-1d3b2afde8b3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1317 microversion: 2.1 time: 0.149226 Aug 10 05:22:44.184170 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 435/873] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:44 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:45.201527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-99ebf247-5526-4627-b5d4-f358677a2fcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:45.202129 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-99ebf247-5526-4627-b5d4-f358677a2fcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:45.209101 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-99ebf247-5526-4627-b5d4-f358677a2fcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:45.209544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-99ebf247-5526-4627-b5d4-f358677a2fcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:45.210307 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-99ebf247-5526-4627-b5d4-f358677a2fcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:45.210765 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-99ebf247-5526-4627-b5d4-f358677a2fcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:45.334273 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-99ebf247-5526-4627-b5d4-f358677a2fcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:45.341573 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-99ebf247-5526-4627-b5d4-f358677a2fcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1507 microversion: 2.1 time: 0.144100 Aug 10 05:22:45.342144 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 439/874] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:45 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1507 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:45.357834 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1891facb-c968-4e58-bde9-1ddd0ae380c5"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:45.359035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:45.365097 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:45.365553 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:45.366330 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:45.366799 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:45.452005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] HTTP exception thrown: Invalid volume: volume 1891facb-c968-4e58-bde9-1ddd0ae380c5 is already attached to instances: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 Aug 10 05:22:45.452535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Returning 400 to user: Invalid volume: volume 1891facb-c968-4e58-bde9-1ddd0ae380c5 is already attached to instances: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:22:45.453376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-778e23cd-0827-414a-bfe4-2896bfa5f6bf tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099597 Aug 10 05:22:45.453915 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 436/875] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:22:45 2021] POST /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 05:22:45.517288 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9fb40e92-155b-4507-b616-25eae263288a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:45.517781 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9fb40e92-155b-4507-b616-25eae263288a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:45.524372 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9fb40e92-155b-4507-b616-25eae263288a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:45.524648 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9fb40e92-155b-4507-b616-25eae263288a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:45.525448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9fb40e92-155b-4507-b616-25eae263288a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:45.525880 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9fb40e92-155b-4507-b616-25eae263288a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:45.611832 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-9fb40e92-155b-4507-b616-25eae263288a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lazy-loading 'services' on Instance uuid 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:22:45.795653 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9fb40e92-155b-4507-b616-25eae263288a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5/os-volume_attachments/1891facb-c968-4e58-bde9-1ddd0ae380c5" status: 202 len: 0 microversion: 2.1 time: 0.281701 Aug 10 05:22:45.796655 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 440/876] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:22:45 2021] DELETE /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5/os-volume_attachments/1891facb-c968-4e58-bde9-1ddd0ae380c5 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:22:45.805220 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3bdd8ab6-2adb-44ee-baca-7c511e8adaf1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:45.806275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3bdd8ab6-2adb-44ee-baca-7c511e8adaf1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:45.812124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3bdd8ab6-2adb-44ee-baca-7c511e8adaf1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:45.812568 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3bdd8ab6-2adb-44ee-baca-7c511e8adaf1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:45.813329 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3bdd8ab6-2adb-44ee-baca-7c511e8adaf1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:45.813762 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3bdd8ab6-2adb-44ee-baca-7c511e8adaf1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:45.843278 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3bdd8ab6-2adb-44ee-baca-7c511e8adaf1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042323 Aug 10 05:22:45.846288 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 437/877] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:22:45 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:22:46.855544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-12b019fd-ac03-496c-834d-dfc212f379f2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:46.856726 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-12b019fd-ac03-496c-834d-dfc212f379f2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:46.863455 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12b019fd-ac03-496c-834d-dfc212f379f2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:46.864105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12b019fd-ac03-496c-834d-dfc212f379f2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:46.864922 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12b019fd-ac03-496c-834d-dfc212f379f2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:46.865316 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12b019fd-ac03-496c-834d-dfc212f379f2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:46.894145 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-12b019fd-ac03-496c-834d-dfc212f379f2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042819 Aug 10 05:22:46.894726 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 441/878] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:22:46 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:22:47.044405 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-831678169", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "84c8fe6e-fb14-4602-8364-2c50daff5aea"}]}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:47.097871 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] validate_networks() for [('84c8fe6e-fb14-4602-8364-2c50daff5aea', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:22:47.458228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:22:47.458727 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:22:47.459241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:22:47.459689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:22:47.460108 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:22:47.468762 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:47.469216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:47.470025 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:47.470504 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:47.488261 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Getting quotas for project 9c1e88b565f34674a368e054f0a19cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:22:47.492788 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Getting quotas for user 7021089fd78c4c70b303877e71bc6215 and project 9c1e88b565f34674a368e054f0a19cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:22:47.503635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:22:47.507028 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:22:47.630331 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e782e9b0-c198-4123-8ab5-3585d67e9ea4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589457 Aug 10 05:22:47.630994 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 438/879] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:22:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:22:47.640580 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-931576bf-20a3-4adc-a680-69e524b9ceb1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:47.641222 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-931576bf-20a3-4adc-a680-69e524b9ceb1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:47.701332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-931576bf-20a3-4adc-a680-69e524b9ceb1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:47.712471 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-931576bf-20a3-4adc-a680-69e524b9ceb1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1217 microversion: 2.1 time: 0.075466 Aug 10 05:22:47.713438 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 442/880] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:47 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:48.728688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b14d7184-2c66-4ea3-ab99-1fe75ce097d9 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:48.729308 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b14d7184-2c66-4ea3-ab99-1fe75ce097d9 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:48.735293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b14d7184-2c66-4ea3-ab99-1fe75ce097d9 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:48.735750 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b14d7184-2c66-4ea3-ab99-1fe75ce097d9 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:48.736807 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b14d7184-2c66-4ea3-ab99-1fe75ce097d9 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:48.737239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b14d7184-2c66-4ea3-ab99-1fe75ce097d9 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:48.796051 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b14d7184-2c66-4ea3-ab99-1fe75ce097d9 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:48.804004 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b14d7184-2c66-4ea3-ab99-1fe75ce097d9 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1213 microversion: 2.1 time: 0.078893 Aug 10 05:22:48.804689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 439/881] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:48 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:49.821320 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7866cebb-58e7-470d-9472-2e46cad9bda6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:49.823751 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7866cebb-58e7-470d-9472-2e46cad9bda6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:49.829903 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7866cebb-58e7-470d-9472-2e46cad9bda6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:49.830713 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7866cebb-58e7-470d-9472-2e46cad9bda6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:49.831769 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7866cebb-58e7-470d-9472-2e46cad9bda6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:49.832441 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7866cebb-58e7-470d-9472-2e46cad9bda6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:49.896792 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7866cebb-58e7-470d-9472-2e46cad9bda6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:49.903804 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7866cebb-58e7-470d-9472-2e46cad9bda6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1275 microversion: 2.1 time: 0.086972 Aug 10 05:22:49.904368 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 443/882] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:49 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:50.927645 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8e540318-2aa2-427d-ac17-1047e2bd6e43 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:50.928370 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8e540318-2aa2-427d-ac17-1047e2bd6e43 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:50.934215 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8e540318-2aa2-427d-ac17-1047e2bd6e43 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:50.934779 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8e540318-2aa2-427d-ac17-1047e2bd6e43 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:50.935612 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8e540318-2aa2-427d-ac17-1047e2bd6e43 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:50.936124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8e540318-2aa2-427d-ac17-1047e2bd6e43 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:51.066548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8e540318-2aa2-427d-ac17-1047e2bd6e43 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:51.076627 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8e540318-2aa2-427d-ac17-1047e2bd6e43 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1317 microversion: 2.1 time: 0.150917 Aug 10 05:22:51.076627 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 440/883] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:50 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:51.143502 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-714c3eb8-6493-48b0-b2e6-6a641b698bcc req-8c967895-8270-463d-8068-08e3db6c410a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3e6b10-eede-4911-9bea-d800ff402647", "tag": "304079a1-545e-4f7f-8eeb-0d648ab15a99"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:51.145054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:51.145054 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:22:51.151874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-714c3eb8-6493-48b0-b2e6-6a641b698bcc req-8c967895-8270-463d-8068-08e3db6c410a service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:51.157011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-714c3eb8-6493-48b0-b2e6-6a641b698bcc req-8c967895-8270-463d-8068-08e3db6c410a service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:51.163761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-714c3eb8-6493-48b0-b2e6-6a641b698bcc req-8c967895-8270-463d-8068-08e3db6c410a service nova] Creating event network-changed:304079a1-545e-4f7f-8eeb-0d648ab15a99 for instance 6d3e6b10-eede-4911-9bea-d800ff402647 on hv-cinder-80390 Aug 10 05:22:51.168787 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-714c3eb8-6493-48b0-b2e6-6a641b698bcc req-8c967895-8270-463d-8068-08e3db6c410a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028933 Aug 10 05:22:51.169770 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 444/884] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:22:52.091125 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0ada58e9-904f-46bc-8358-6ed27c83fdfc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:52.091775 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-0ada58e9-904f-46bc-8358-6ed27c83fdfc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:52.097525 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0ada58e9-904f-46bc-8358-6ed27c83fdfc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:52.097978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0ada58e9-904f-46bc-8358-6ed27c83fdfc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:52.098768 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0ada58e9-904f-46bc-8358-6ed27c83fdfc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:52.099207 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-0ada58e9-904f-46bc-8358-6ed27c83fdfc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:52.216386 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-0ada58e9-904f-46bc-8358-6ed27c83fdfc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:52.223572 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0ada58e9-904f-46bc-8358-6ed27c83fdfc tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1317 microversion: 2.1 time: 0.136207 Aug 10 05:22:52.224135 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 441/885] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:52 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:53.240915 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aadaaa9a-ada6-4d4f-aecb-b5ca8c6be895 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:53.241648 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-aadaaa9a-ada6-4d4f-aecb-b5ca8c6be895 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:53.247652 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aadaaa9a-ada6-4d4f-aecb-b5ca8c6be895 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:53.248320 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aadaaa9a-ada6-4d4f-aecb-b5ca8c6be895 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:53.248887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aadaaa9a-ada6-4d4f-aecb-b5ca8c6be895 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:53.249321 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aadaaa9a-ada6-4d4f-aecb-b5ca8c6be895 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:53.366681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aadaaa9a-ada6-4d4f-aecb-b5ca8c6be895 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:53.373777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aadaaa9a-ada6-4d4f-aecb-b5ca8c6be895 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1317 microversion: 2.1 time: 0.137061 Aug 10 05:22:53.374340 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 445/886] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:53 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:54.389488 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c0b7e49b-0947-4b6a-9726-2b21f45b94e1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:54.390102 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c0b7e49b-0947-4b6a-9726-2b21f45b94e1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:54.395962 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c0b7e49b-0947-4b6a-9726-2b21f45b94e1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:54.396415 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c0b7e49b-0947-4b6a-9726-2b21f45b94e1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:54.397223 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c0b7e49b-0947-4b6a-9726-2b21f45b94e1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:54.397662 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c0b7e49b-0947-4b6a-9726-2b21f45b94e1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:54.520356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c0b7e49b-0947-4b6a-9726-2b21f45b94e1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:54.528156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c0b7e49b-0947-4b6a-9726-2b21f45b94e1 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1317 microversion: 2.1 time: 0.142340 Aug 10 05:22:54.528716 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 442/887] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:54 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:55.545079 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f8db4ee0-f0d1-42ee-9b7d-d00f24a71a94 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:55.545682 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f8db4ee0-f0d1-42ee-9b7d-d00f24a71a94 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:55.551963 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8db4ee0-f0d1-42ee-9b7d-d00f24a71a94 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:55.552411 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8db4ee0-f0d1-42ee-9b7d-d00f24a71a94 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:55.553172 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8db4ee0-f0d1-42ee-9b7d-d00f24a71a94 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:55.553600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f8db4ee0-f0d1-42ee-9b7d-d00f24a71a94 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:55.683061 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f8db4ee0-f0d1-42ee-9b7d-d00f24a71a94 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:55.690205 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f8db4ee0-f0d1-42ee-9b7d-d00f24a71a94 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1317 microversion: 2.1 time: 0.148725 Aug 10 05:22:55.690791 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 446/888] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:55 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:22:56.707403 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ba53125d-917b-4ff3-abf5-983fb5f3c821 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:56.708610 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ba53125d-917b-4ff3-abf5-983fb5f3c821 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:56.714651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ba53125d-917b-4ff3-abf5-983fb5f3c821 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:56.715107 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ba53125d-917b-4ff3-abf5-983fb5f3c821 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:56.716081 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ba53125d-917b-4ff3-abf5-983fb5f3c821 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:56.716536 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ba53125d-917b-4ff3-abf5-983fb5f3c821 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:56.812004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-ee785f1e-0226-4de7-8225-1780b87aa554 req-1753e2ef-28bf-424f-993c-1d323d90c3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3e6b10-eede-4911-9bea-d800ff402647", "name": "network-vif-plugged", "status": "completed", "tag": "304079a1-545e-4f7f-8eeb-0d648ab15a99"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:22:56.814977 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:22:56.814977 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:22:56.823377 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-ee785f1e-0226-4de7-8225-1780b87aa554 req-1753e2ef-28bf-424f-993c-1d323d90c3a1 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:56.824107 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-ee785f1e-0226-4de7-8225-1780b87aa554 req-1753e2ef-28bf-424f-993c-1d323d90c3a1 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:56.836552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-ee785f1e-0226-4de7-8225-1780b87aa554 req-1753e2ef-28bf-424f-993c-1d323d90c3a1 service nova] Creating event network-vif-plugged:304079a1-545e-4f7f-8eeb-0d648ab15a99 for instance 6d3e6b10-eede-4911-9bea-d800ff402647 on hv-cinder-80390 Aug 10 05:22:56.837248 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ba53125d-917b-4ff3-abf5-983fb5f3c821 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:56.842305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-ee785f1e-0226-4de7-8225-1780b87aa554 req-1753e2ef-28bf-424f-993c-1d323d90c3a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036156 Aug 10 05:22:56.842951 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 447/889] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:22:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:22:56.848071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ba53125d-917b-4ff3-abf5-983fb5f3c821 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1317 microversion: 2.1 time: 0.144348 Aug 10 05:22:56.848726 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 443/890] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:56 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:57.864585 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-89144b8a-5f4e-4ca4-b547-f657bef7354f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:57.865430 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-89144b8a-5f4e-4ca4-b547-f657bef7354f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:57.871669 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89144b8a-5f4e-4ca4-b547-f657bef7354f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:57.872119 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89144b8a-5f4e-4ca4-b547-f657bef7354f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:57.872900 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89144b8a-5f4e-4ca4-b547-f657bef7354f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:57.873333 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-89144b8a-5f4e-4ca4-b547-f657bef7354f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:58.005943 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-89144b8a-5f4e-4ca4-b547-f657bef7354f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:58.013443 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-89144b8a-5f4e-4ca4-b547-f657bef7354f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1317 microversion: 2.1 time: 0.153182 Aug 10 05:22:58.014328 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 448/891] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:57 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:22:59.030504 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-95c764bc-8edb-493f-ab62-5784e51e9bcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:22:59.031087 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-95c764bc-8edb-493f-ab62-5784e51e9bcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:22:59.037378 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-95c764bc-8edb-493f-ab62-5784e51e9bcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:59.037833 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-95c764bc-8edb-493f-ab62-5784e51e9bcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:59.038624 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-95c764bc-8edb-493f-ab62-5784e51e9bcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:22:59.039065 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-95c764bc-8edb-493f-ab62-5784e51e9bcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:22:59.159155 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-95c764bc-8edb-493f-ab62-5784e51e9bcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:22:59.167039 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-95c764bc-8edb-493f-ab62-5784e51e9bcd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1506 microversion: 2.1 time: 0.140245 Aug 10 05:22:59.167598 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 444/892] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:22:59 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1506 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:00.865176 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-53867245-294f-498a-b801-d7bcf827a015 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7311b8a5-eb70-47ee-a47e-4419e4b99c63"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:00.866227 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-53867245-294f-498a-b801-d7bcf827a015 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:00.871971 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53867245-294f-498a-b801-d7bcf827a015 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:00.872421 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53867245-294f-498a-b801-d7bcf827a015 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:00.877439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53867245-294f-498a-b801-d7bcf827a015 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:00.877439 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-53867245-294f-498a-b801-d7bcf827a015 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:01.666242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-53867245-294f-498a-b801-d7bcf827a015 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805549 Aug 10 05:23:01.667237 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 449/893] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:23:00 2021] POST /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:23:09.189461 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7311b8a5-eb70-47ee-a47e-4419e4b99c63"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:09.190603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:09.196998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:09.197459 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:09.198233 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:09.198733 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:09.283977 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] HTTP exception thrown: Invalid volume: volume 7311b8a5-eb70-47ee-a47e-4419e4b99c63 is already attached to instances: 6d3e6b10-eede-4911-9bea-d800ff402647 Aug 10 05:23:09.284609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Returning 400 to user: Invalid volume: volume 7311b8a5-eb70-47ee-a47e-4419e4b99c63 is already attached to instances: 6d3e6b10-eede-4911-9bea-d800ff402647 {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:23:09.285453 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-22b4d14b-d259-44d2-b2ad-2e3ac3bd8d6b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099810 Aug 10 05:23:09.286002 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 445/894] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:23:09 2021] POST /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 05:23:09.349961 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4391cb74-0ee3-4506-8243-ba6d8e0ef905 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:09.351193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4391cb74-0ee3-4506-8243-ba6d8e0ef905 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:09.357470 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4391cb74-0ee3-4506-8243-ba6d8e0ef905 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:09.357915 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4391cb74-0ee3-4506-8243-ba6d8e0ef905 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:09.358711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4391cb74-0ee3-4506-8243-ba6d8e0ef905 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:09.359146 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4391cb74-0ee3-4506-8243-ba6d8e0ef905 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:09.443408 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-4391cb74-0ee3-4506-8243-ba6d8e0ef905 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lazy-loading 'services' on Instance uuid 6d3e6b10-eede-4911-9bea-d800ff402647 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:23:09.683874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4391cb74-0ee3-4506-8243-ba6d8e0ef905 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments/7311b8a5-eb70-47ee-a47e-4419e4b99c63" status: 202 len: 0 microversion: 2.1 time: 0.338706 Aug 10 05:23:09.684418 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 450/895] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:23:09 2021] DELETE /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments/7311b8a5-eb70-47ee-a47e-4419e4b99c63 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:23:09.692603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d74efa98-710a-4f29-af80-d59fa778a5a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:09.693689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d74efa98-710a-4f29-af80-d59fa778a5a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:09.699920 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d74efa98-710a-4f29-af80-d59fa778a5a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:09.700371 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d74efa98-710a-4f29-af80-d59fa778a5a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:09.701150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d74efa98-710a-4f29-af80-d59fa778a5a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:09.701586 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d74efa98-710a-4f29-af80-d59fa778a5a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:09.732073 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d74efa98-710a-4f29-af80-d59fa778a5a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Aug 10 05:23:09.732615 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 446/896] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:23:09 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:10.743630 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2796f617-f6f3-42ed-a6fd-7b0a8716fe3b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:10.744681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2796f617-f6f3-42ed-a6fd-7b0a8716fe3b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:10.750997 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2796f617-f6f3-42ed-a6fd-7b0a8716fe3b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:10.751445 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2796f617-f6f3-42ed-a6fd-7b0a8716fe3b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:10.752208 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2796f617-f6f3-42ed-a6fd-7b0a8716fe3b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:10.752640 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2796f617-f6f3-42ed-a6fd-7b0a8716fe3b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:10.782192 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2796f617-f6f3-42ed-a6fd-7b0a8716fe3b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Aug 10 05:23:10.782762 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 451/897] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:23:10 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:11.794024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a8662c4c-c494-477f-b9c1-563df584e0ff tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:11.794876 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a8662c4c-c494-477f-b9c1-563df584e0ff tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:11.801289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8662c4c-c494-477f-b9c1-563df584e0ff tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:11.802407 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8662c4c-c494-477f-b9c1-563df584e0ff tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:11.803239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8662c4c-c494-477f-b9c1-563df584e0ff tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:11.803674 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8662c4c-c494-477f-b9c1-563df584e0ff tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:11.831980 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a8662c4c-c494-477f-b9c1-563df584e0ff tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041770 Aug 10 05:23:11.832523 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 447/898] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:23:11 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:23:11.987468 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1297350077", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "84c8fe6e-fb14-4602-8364-2c50daff5aea"}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:12.038784 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] validate_networks() for [('84c8fe6e-fb14-4602-8364-2c50daff5aea', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:23:12.398027 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:23:12.398615 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:23:12.399098 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:23:12.399508 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:23:12.399919 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:23:12.408600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:12.409049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:12.409852 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:12.410286 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:12.426534 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Getting quotas for project 9c1e88b565f34674a368e054f0a19cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:23:12.431308 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Getting quotas for user 7021089fd78c4c70b303877e71bc6215 and project 9c1e88b565f34674a368e054f0a19cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:23:12.442365 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:23:12.444695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:23:12.594824 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-edd0038a-95bc-44d1-9501-768336194f42 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610420 Aug 10 05:23:12.599467 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 452/899] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:23:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:23:12.604796 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d17ab08b-5350-4578-a057-0ff0ce10fdf7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:12.605421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d17ab08b-5350-4578-a057-0ff0ce10fdf7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:12.657340 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d17ab08b-5350-4578-a057-0ff0ce10fdf7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:12.664528 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d17ab08b-5350-4578-a057-0ff0ce10fdf7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1218 microversion: 2.1 time: 0.063417 Aug 10 05:23:12.665089 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 448/900] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:12 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:23:13.681498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-397055d2-3e3e-4d10-aff6-eb2b9834f84b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:13.682119 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-397055d2-3e3e-4d10-aff6-eb2b9834f84b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:13.688216 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-397055d2-3e3e-4d10-aff6-eb2b9834f84b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:13.688661 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-397055d2-3e3e-4d10-aff6-eb2b9834f84b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:13.689618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-397055d2-3e3e-4d10-aff6-eb2b9834f84b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:13.690048 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-397055d2-3e3e-4d10-aff6-eb2b9834f84b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:13.750793 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-397055d2-3e3e-4d10-aff6-eb2b9834f84b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:13.758291 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-397055d2-3e3e-4d10-aff6-eb2b9834f84b tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1214 microversion: 2.1 time: 0.080435 Aug 10 05:23:13.758887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 453/901] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:13 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:14.781136 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a932e736-42fd-44d9-b978-a55e31f4439a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:14.781944 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a932e736-42fd-44d9-b978-a55e31f4439a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:14.787798 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a932e736-42fd-44d9-b978-a55e31f4439a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:14.788336 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a932e736-42fd-44d9-b978-a55e31f4439a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:14.789209 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a932e736-42fd-44d9-b978-a55e31f4439a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:14.789705 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a932e736-42fd-44d9-b978-a55e31f4439a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:14.864508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a932e736-42fd-44d9-b978-a55e31f4439a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:14.871974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a932e736-42fd-44d9-b978-a55e31f4439a tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1276 microversion: 2.1 time: 0.094772 Aug 10 05:23:14.872539 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 449/902] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:14 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:15.888987 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-94f014c0-cd18-4c31-868f-f884b4f75ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:15.889591 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-94f014c0-cd18-4c31-868f-f884b4f75ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:15.895883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94f014c0-cd18-4c31-868f-f884b4f75ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:15.896327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94f014c0-cd18-4c31-868f-f884b4f75ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:15.897107 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94f014c0-cd18-4c31-868f-f884b4f75ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:15.897533 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94f014c0-cd18-4c31-868f-f884b4f75ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:15.997595 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-33d1cae8-69bb-4e03-8946-17742ed75394 req-647a46a3-90b6-41ab-904d-54c1fc5bf316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24944267-7f97-4622-827f-96f9b2e100e5", "tag": "eb413b89-0802-48ea-b284-5887873ea6fc"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:15.999274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:23:15.999274 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:23:16.007842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-33d1cae8-69bb-4e03-8946-17742ed75394 req-647a46a3-90b6-41ab-904d-54c1fc5bf316 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:16.008578 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-33d1cae8-69bb-4e03-8946-17742ed75394 req-647a46a3-90b6-41ab-904d-54c1fc5bf316 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:16.021518 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-33d1cae8-69bb-4e03-8946-17742ed75394 req-647a46a3-90b6-41ab-904d-54c1fc5bf316 service nova] Creating event network-changed:eb413b89-0802-48ea-b284-5887873ea6fc for instance 24944267-7f97-4622-827f-96f9b2e100e5 on hv-cinder-80390 Aug 10 05:23:16.046832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-33d1cae8-69bb-4e03-8946-17742ed75394 req-647a46a3-90b6-41ab-904d-54c1fc5bf316 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032591 Aug 10 05:23:16.046832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 450/903] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:23:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:23:16.047157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-94f014c0-cd18-4c31-868f-f884b4f75ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:16.047157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-94f014c0-cd18-4c31-868f-f884b4f75ff2 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1318 microversion: 2.1 time: 0.151304 Aug 10 05:23:16.047157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 454/904] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:15 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:17.054905 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9206b9f2-657e-4fb6-b112-38b2ef6bb2d7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:17.055624 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9206b9f2-657e-4fb6-b112-38b2ef6bb2d7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:17.061738 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9206b9f2-657e-4fb6-b112-38b2ef6bb2d7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:17.062196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9206b9f2-657e-4fb6-b112-38b2ef6bb2d7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:17.062995 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9206b9f2-657e-4fb6-b112-38b2ef6bb2d7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:17.063441 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9206b9f2-657e-4fb6-b112-38b2ef6bb2d7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:17.181215 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9206b9f2-657e-4fb6-b112-38b2ef6bb2d7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:17.188307 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9206b9f2-657e-4fb6-b112-38b2ef6bb2d7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1318 microversion: 2.1 time: 0.138276 Aug 10 05:23:17.188873 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 451/905] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:17 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:18.205514 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-29d610fb-9092-4203-8da9-e16a1e9eadbd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:18.206141 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-29d610fb-9092-4203-8da9-e16a1e9eadbd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:18.212297 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-29d610fb-9092-4203-8da9-e16a1e9eadbd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:18.212748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-29d610fb-9092-4203-8da9-e16a1e9eadbd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:18.213529 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-29d610fb-9092-4203-8da9-e16a1e9eadbd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:18.213964 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-29d610fb-9092-4203-8da9-e16a1e9eadbd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:18.333468 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-29d610fb-9092-4203-8da9-e16a1e9eadbd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:18.340718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-29d610fb-9092-4203-8da9-e16a1e9eadbd tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1318 microversion: 2.1 time: 0.139182 Aug 10 05:23:18.341282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 455/906] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:18 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:19.357776 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9d2dcdb9-6d36-4758-9afa-2bbfde225b14 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:19.358386 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9d2dcdb9-6d36-4758-9afa-2bbfde225b14 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:19.364944 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d2dcdb9-6d36-4758-9afa-2bbfde225b14 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:19.365387 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d2dcdb9-6d36-4758-9afa-2bbfde225b14 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:19.366146 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d2dcdb9-6d36-4758-9afa-2bbfde225b14 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:19.366628 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d2dcdb9-6d36-4758-9afa-2bbfde225b14 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:19.489187 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9d2dcdb9-6d36-4758-9afa-2bbfde225b14 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:19.496258 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9d2dcdb9-6d36-4758-9afa-2bbfde225b14 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1318 microversion: 2.1 time: 0.142185 Aug 10 05:23:19.496816 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 452/907] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:19 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:20.513338 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-679ec3b1-24ce-46f6-a7b2-18720ed274a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:20.514186 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-679ec3b1-24ce-46f6-a7b2-18720ed274a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:20.520006 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-679ec3b1-24ce-46f6-a7b2-18720ed274a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:20.520964 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-679ec3b1-24ce-46f6-a7b2-18720ed274a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:20.521749 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-679ec3b1-24ce-46f6-a7b2-18720ed274a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:20.522185 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-679ec3b1-24ce-46f6-a7b2-18720ed274a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:20.638902 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-679ec3b1-24ce-46f6-a7b2-18720ed274a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:20.646765 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-679ec3b1-24ce-46f6-a7b2-18720ed274a4 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1318 microversion: 2.1 time: 0.137292 Aug 10 05:23:20.647341 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 456/908] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:20 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:21.663729 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-25a55a18-f14d-4386-a066-ae675251440f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:21.664338 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-25a55a18-f14d-4386-a066-ae675251440f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:21.670050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25a55a18-f14d-4386-a066-ae675251440f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:21.670497 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25a55a18-f14d-4386-a066-ae675251440f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:21.671314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25a55a18-f14d-4386-a066-ae675251440f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:21.671734 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-25a55a18-f14d-4386-a066-ae675251440f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:21.789955 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-25a55a18-f14d-4386-a066-ae675251440f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:21.797181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-25a55a18-f14d-4386-a066-ae675251440f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1318 microversion: 2.1 time: 0.137581 Aug 10 05:23:21.797743 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 453/909] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:21 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:22.813548 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-dde92bd0-0119-474e-bd9e-3b5c3d0cd4de tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:22.814157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-dde92bd0-0119-474e-bd9e-3b5c3d0cd4de tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:22.820088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dde92bd0-0119-474e-bd9e-3b5c3d0cd4de tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:22.820798 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dde92bd0-0119-474e-bd9e-3b5c3d0cd4de tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:22.821329 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dde92bd0-0119-474e-bd9e-3b5c3d0cd4de tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:22.821761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dde92bd0-0119-474e-bd9e-3b5c3d0cd4de tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:22.949563 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-dde92bd0-0119-474e-bd9e-3b5c3d0cd4de tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:22.958823 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-dde92bd0-0119-474e-bd9e-3b5c3d0cd4de tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1318 microversion: 2.1 time: 0.147654 Aug 10 05:23:22.958823 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 457/910] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:22 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:22.962167 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-062227d7-d539-47e1-89d0-8e55c849a08e req-9fe28d84-a160-4ae1-ac07-ccf4a84758b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24944267-7f97-4622-827f-96f9b2e100e5", "name": "network-vif-plugged", "status": "completed", "tag": "eb413b89-0802-48ea-b284-5887873ea6fc"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:22.964842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:23:22.964842 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:23:22.973814 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-062227d7-d539-47e1-89d0-8e55c849a08e req-9fe28d84-a160-4ae1-ac07-ccf4a84758b1 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:22.974260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-062227d7-d539-47e1-89d0-8e55c849a08e req-9fe28d84-a160-4ae1-ac07-ccf4a84758b1 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:22.985056 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-062227d7-d539-47e1-89d0-8e55c849a08e req-9fe28d84-a160-4ae1-ac07-ccf4a84758b1 service nova] Creating event network-vif-plugged:eb413b89-0802-48ea-b284-5887873ea6fc for instance 24944267-7f97-4622-827f-96f9b2e100e5 on hv-cinder-80390 Aug 10 05:23:22.990773 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-062227d7-d539-47e1-89d0-8e55c849a08e req-9fe28d84-a160-4ae1-ac07-ccf4a84758b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034251 Aug 10 05:23:22.991346 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 454/911] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:23:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:23.973688 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-082757e9-ada9-432a-b828-16bafea07040 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:23.974323 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-082757e9-ada9-432a-b828-16bafea07040 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:23.980077 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-082757e9-ada9-432a-b828-16bafea07040 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:23.980523 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-082757e9-ada9-432a-b828-16bafea07040 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:23.981291 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-082757e9-ada9-432a-b828-16bafea07040 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:23.981727 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-082757e9-ada9-432a-b828-16bafea07040 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:24.101613 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-082757e9-ada9-432a-b828-16bafea07040 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:24.108508 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-082757e9-ada9-432a-b828-16bafea07040 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1318 microversion: 2.1 time: 0.138494 Aug 10 05:23:24.109068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 458/912] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:23 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:25.125758 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f3825f89-483b-47df-bf04-2c3f2e141e8d tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:25.126376 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f3825f89-483b-47df-bf04-2c3f2e141e8d tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:25.132932 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f3825f89-483b-47df-bf04-2c3f2e141e8d tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:25.133325 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f3825f89-483b-47df-bf04-2c3f2e141e8d tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:25.134086 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f3825f89-483b-47df-bf04-2c3f2e141e8d tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:25.134522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f3825f89-483b-47df-bf04-2c3f2e141e8d tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:25.266903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f3825f89-483b-47df-bf04-2c3f2e141e8d tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:25.266903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f3825f89-483b-47df-bf04-2c3f2e141e8d tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1508 microversion: 2.1 time: 0.141388 Aug 10 05:23:25.266903 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 455/913] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:25 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:26.927205 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-539bf4c5-e5f1-483d-aee1-5f439c02d86f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ce9e378-45c8-45cb-a766-8bbf56c328d1"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:26.928777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-539bf4c5-e5f1-483d-aee1-5f439c02d86f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:26.934413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-539bf4c5-e5f1-483d-aee1-5f439c02d86f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:26.934897 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-539bf4c5-e5f1-483d-aee1-5f439c02d86f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:26.935660 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-539bf4c5-e5f1-483d-aee1-5f439c02d86f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:26.936092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-539bf4c5-e5f1-483d-aee1-5f439c02d86f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:27.687314 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-539bf4c5-e5f1-483d-aee1-5f439c02d86f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "POST /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.763531 Aug 10 05:23:27.687832 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 459/914] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:23:26 2021] POST /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments => generated 194 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:35.290053 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4ddd2040-0056-4ae9-81b4-ba1fdaae2beb tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:35.290619 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4ddd2040-0056-4ae9-81b4-ba1fdaae2beb tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:35.296453 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4ddd2040-0056-4ae9-81b4-ba1fdaae2beb tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:35.296915 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4ddd2040-0056-4ae9-81b4-ba1fdaae2beb tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:35.299721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4ddd2040-0056-4ae9-81b4-ba1fdaae2beb tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:35.299721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4ddd2040-0056-4ae9-81b4-ba1fdaae2beb tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:35.381598 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-4ddd2040-0056-4ae9-81b4-ba1fdaae2beb tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lazy-loading 'services' on Instance uuid 24944267-7f97-4622-827f-96f9b2e100e5 {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:23:35.605528 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4ddd2040-0056-4ae9-81b4-ba1fdaae2beb tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments/8ce9e378-45c8-45cb-a766-8bbf56c328d1" status: 202 len: 0 microversion: 2.1 time: 0.317135 Aug 10 05:23:35.605528 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 456/915] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:23:35 2021] DELETE /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments/8ce9e378-45c8-45cb-a766-8bbf56c328d1 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:23:35.613498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-706cf2b8-44e6-456d-9dd9-12fe01987769 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:35.614661 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-706cf2b8-44e6-456d-9dd9-12fe01987769 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:35.620812 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-706cf2b8-44e6-456d-9dd9-12fe01987769 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:35.621359 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-706cf2b8-44e6-456d-9dd9-12fe01987769 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:35.622228 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-706cf2b8-44e6-456d-9dd9-12fe01987769 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:35.622874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-706cf2b8-44e6-456d-9dd9-12fe01987769 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:35.653704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-706cf2b8-44e6-456d-9dd9-12fe01987769 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Aug 10 05:23:35.654266 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 460/916] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:23:35 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:36.665736 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8b63332c-4dea-4a25-8a00-02ac32c5d970 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:36.666838 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8b63332c-4dea-4a25-8a00-02ac32c5d970 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:36.672855 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8b63332c-4dea-4a25-8a00-02ac32c5d970 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:36.673309 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8b63332c-4dea-4a25-8a00-02ac32c5d970 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:36.674172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8b63332c-4dea-4a25-8a00-02ac32c5d970 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:36.674635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8b63332c-4dea-4a25-8a00-02ac32c5d970 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:36.705362 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8b63332c-4dea-4a25-8a00-02ac32c5d970 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Aug 10 05:23:36.706160 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 457/917] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:23:36 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:37.236333 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1fd86949-dbf1-4283-8d32-3b872a7af344 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:37.237306 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1fd86949-dbf1-4283-8d32-3b872a7af344 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:37.239696 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-c7406167-f2c9-4547-b527-7f767970bc98 req-4e0cc370-bed9-4cc1-8b95-c8b1170dda87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766cb709-769b-418b-ad7e-d2360a7f57e8", "tag": "c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:37.242179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:23:37.242179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:23:37.245279 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1fd86949-dbf1-4283-8d32-3b872a7af344 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:37.245863 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1fd86949-dbf1-4283-8d32-3b872a7af344 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:37.246793 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1fd86949-dbf1-4283-8d32-3b872a7af344 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:37.247511 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1fd86949-dbf1-4283-8d32-3b872a7af344 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:37.249688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-c7406167-f2c9-4547-b527-7f767970bc98 req-4e0cc370-bed9-4cc1-8b95-c8b1170dda87 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:37.250336 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-c7406167-f2c9-4547-b527-7f767970bc98 req-4e0cc370-bed9-4cc1-8b95-c8b1170dda87 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:37.262717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-c7406167-f2c9-4547-b527-7f767970bc98 req-4e0cc370-bed9-4cc1-8b95-c8b1170dda87 service nova] Creating event network-changed:c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154 for instance 766cb709-769b-418b-ad7e-d2360a7f57e8 on hv-cinder-80390 Aug 10 05:23:37.267450 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-c7406167-f2c9-4547-b527-7f767970bc98 req-4e0cc370-bed9-4cc1-8b95-c8b1170dda87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032350 Aug 10 05:23:37.268746 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 458/918] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:23:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:23:37.274801 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1fd86949-dbf1-4283-8d32-3b872a7af344 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:23:37.656095 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1fd86949-dbf1-4283-8d32-3b872a7af344 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "DELETE /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 204 len: 0 microversion: 2.1 time: 0.424595 Aug 10 05:23:37.659591 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 461/919] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:23:37 2021] DELETE /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:23:37.665109 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ac56e394-815b-48e4-89d5-cc4e6054dedb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:37.665792 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ac56e394-815b-48e4-89d5-cc4e6054dedb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:37.671869 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac56e394-815b-48e4-89d5-cc4e6054dedb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:37.672320 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac56e394-815b-48e4-89d5-cc4e6054dedb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:37.673090 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac56e394-815b-48e4-89d5-cc4e6054dedb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:37.673522 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac56e394-815b-48e4-89d5-cc4e6054dedb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:37.717486 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5aa924db-e490-44e1-96c2-1ebc5dd2c741 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:37.718869 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5aa924db-e490-44e1-96c2-1ebc5dd2c741 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:37.726835 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5aa924db-e490-44e1-96c2-1ebc5dd2c741 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:37.727415 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5aa924db-e490-44e1-96c2-1ebc5dd2c741 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:37.728215 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5aa924db-e490-44e1-96c2-1ebc5dd2c741 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:37.728649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5aa924db-e490-44e1-96c2-1ebc5dd2c741 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:37.760277 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5aa924db-e490-44e1-96c2-1ebc5dd2c741 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046987 Aug 10 05:23:37.760845 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 462/920] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:23:37 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 05:23:37.886924 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ac56e394-815b-48e4-89d5-cc4e6054dedb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:37.894286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ac56e394-815b-48e4-89d5-cc4e6054dedb tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1569 microversion: 2.1 time: 0.233229 Aug 10 05:23:37.894957 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 459/921] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:37 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:39.118700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b9b22ade-17b1-4893-bfab-b470fc8db588 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:39.119327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b9b22ade-17b1-4893-bfab-b470fc8db588 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:39.125652 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b9b22ade-17b1-4893-bfab-b470fc8db588 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:39.126114 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b9b22ade-17b1-4893-bfab-b470fc8db588 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:39.126937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b9b22ade-17b1-4893-bfab-b470fc8db588 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:39.127380 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b9b22ade-17b1-4893-bfab-b470fc8db588 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:39.162659 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:23:39.162852 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: Tue Aug 10 05:23:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 (ip 10.222.0.16) !!! Aug 10 05:23:39.164220 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-44b6debe-5e64-48ee-b57b-aea7c0aa84ef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:39.164712 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-44b6debe-5e64-48ee-b57b-aea7c0aa84ef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:39.175755 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-44b6debe-5e64-48ee-b57b-aea7c0aa84ef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:39.176475 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-44b6debe-5e64-48ee-b57b-aea7c0aa84ef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:39.177571 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-44b6debe-5e64-48ee-b57b-aea7c0aa84ef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:39.178200 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-44b6debe-5e64-48ee-b57b-aea7c0aa84ef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:39.208783 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-44b6debe-5e64-48ee-b57b-aea7c0aa84ef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Going to try to terminate instance {{(pid=108137) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:23:39.279899 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b9b22ade-17b1-4893-bfab-b470fc8db588 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:39.287728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b9b22ade-17b1-4893-bfab-b470fc8db588 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1451 microversion: 2.1 time: 0.378976 Aug 10 05:23:39.288315 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 463/922] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:38 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1451 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:39.529956 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-44b6debe-5e64-48ee-b57b-aea7c0aa84ef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 204 len: 0 microversion: 2.1 time: 0.368025 Aug 10 05:23:39.531273 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 460/923] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:23:39 2021] DELETE /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 05:23:39.541828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-cbd47164-07d1-47c9-9d84-3f244f3ad5a0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:39.543420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-cbd47164-07d1-47c9-9d84-3f244f3ad5a0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:39.552494 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cbd47164-07d1-47c9-9d84-3f244f3ad5a0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:39.553122 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cbd47164-07d1-47c9-9d84-3f244f3ad5a0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:39.554853 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cbd47164-07d1-47c9-9d84-3f244f3ad5a0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:39.555513 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cbd47164-07d1-47c9-9d84-3f244f3ad5a0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:39.817544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-cbd47164-07d1-47c9-9d84-3f244f3ad5a0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:39.827563 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-cbd47164-07d1-47c9-9d84-3f244f3ad5a0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1514 microversion: 2.1 time: 0.291636 Aug 10 05:23:39.828821 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 464/924] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:39 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:40.012060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-2696d3d3-3166-4299-9ed0-580fc58ab14b req-d18ae1b6-436e-4782-9734-ba97a29c26c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766cb709-769b-418b-ad7e-d2360a7f57e8", "name": "network-vif-deleted", "tag": "c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:40.013735 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:23:40.013735 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:23:40.020723 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-2696d3d3-3166-4299-9ed0-580fc58ab14b req-d18ae1b6-436e-4782-9734-ba97a29c26c0 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:40.021172 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-2696d3d3-3166-4299-9ed0-580fc58ab14b req-d18ae1b6-436e-4782-9734-ba97a29c26c0 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:40.037638 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-2696d3d3-3166-4299-9ed0-580fc58ab14b req-d18ae1b6-436e-4782-9734-ba97a29c26c0 service nova] Creating event network-vif-deleted:c54c4f1e-d61f-4abd-8e1c-fcc75a2fa154 for instance 766cb709-769b-418b-ad7e-d2360a7f57e8 on hv-cinder-80390 Aug 10 05:23:40.043049 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-2696d3d3-3166-4299-9ed0-580fc58ab14b req-d18ae1b6-436e-4782-9734-ba97a29c26c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039128 Aug 10 05:23:40.043654 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 461/925] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:23:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:40.306295 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4e4f2481-e7eb-4164-a61b-e7320f6f5fbc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:40.307570 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4e4f2481-e7eb-4164-a61b-e7320f6f5fbc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:40.313952 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4e4f2481-e7eb-4164-a61b-e7320f6f5fbc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:40.314708 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4e4f2481-e7eb-4164-a61b-e7320f6f5fbc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:40.315557 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4e4f2481-e7eb-4164-a61b-e7320f6f5fbc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:40.316181 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4e4f2481-e7eb-4164-a61b-e7320f6f5fbc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:40.384232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4e4f2481-e7eb-4164-a61b-e7320f6f5fbc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:40.396105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4e4f2481-e7eb-4164-a61b-e7320f6f5fbc tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1220 microversion: 2.1 time: 0.094523 Aug 10 05:23:40.396692 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 465/926] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:40 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:40.845605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b90dc0f4-3d88-48c5-b82b-ba5935ab3bee tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:40.846316 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b90dc0f4-3d88-48c5-b82b-ba5935ab3bee tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:40.852666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b90dc0f4-3d88-48c5-b82b-ba5935ab3bee tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:40.853133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b90dc0f4-3d88-48c5-b82b-ba5935ab3bee tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:40.854110 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b90dc0f4-3d88-48c5-b82b-ba5935ab3bee tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:40.854753 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b90dc0f4-3d88-48c5-b82b-ba5935ab3bee tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:41.064149 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b90dc0f4-3d88-48c5-b82b-ba5935ab3bee tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:41.072177 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b90dc0f4-3d88-48c5-b82b-ba5935ab3bee tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1514 microversion: 2.1 time: 0.230551 Aug 10 05:23:41.072748 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 462/927] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:40 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:41.415138 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:41.415750 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:41.423287 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:41.424289 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:41.425383 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:41.425984 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:41.466591 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:41.467307 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:41.467761 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lazy-loading 'fault' on Instance uuid 766cb709-769b-418b-ad7e-d2360a7f57e8 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:23:41.507624 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3378945fb3734bb395995268af72960d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0757c9f3474f1d8d45d02c87abef53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:41.515814 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f81632ba-a326-4dea-b498-18fd450df85a tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 200 len: 1225 microversion: 2.1 time: 0.105085 Aug 10 05:23:41.516389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 466/928] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:41 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:42.089481 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-acc8582d-fe15-4e96-bc06-e2fd4afe9994 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:42.090133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-acc8582d-fe15-4e96-bc06-e2fd4afe9994 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:42.101017 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-acc8582d-fe15-4e96-bc06-e2fd4afe9994 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:42.102079 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-acc8582d-fe15-4e96-bc06-e2fd4afe9994 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:42.103094 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-acc8582d-fe15-4e96-bc06-e2fd4afe9994 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:42.103713 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-acc8582d-fe15-4e96-bc06-e2fd4afe9994 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:42.225061 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-acc8582d-fe15-4e96-bc06-e2fd4afe9994 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:42.234887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-acc8582d-fe15-4e96-bc06-e2fd4afe9994 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 200 len: 1472 microversion: 2.1 time: 0.148553 Aug 10 05:23:42.236106 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 463/929] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:42 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 1472 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:42.258340 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-2b34b39a-79a2-47ac-b0b7-498e89e0a6f0 req-61d85447-a089-4bc0-9f27-3c4d9e7a1f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24944267-7f97-4622-827f-96f9b2e100e5", "name": "network-vif-deleted", "tag": "eb413b89-0802-48ea-b284-5887873ea6fc"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:42.260990 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:23:42.260990 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:23:42.268568 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-2b34b39a-79a2-47ac-b0b7-498e89e0a6f0 req-61d85447-a089-4bc0-9f27-3c4d9e7a1f0a service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:42.269210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-2b34b39a-79a2-47ac-b0b7-498e89e0a6f0 req-61d85447-a089-4bc0-9f27-3c4d9e7a1f0a service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:42.287868 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-2b34b39a-79a2-47ac-b0b7-498e89e0a6f0 req-61d85447-a089-4bc0-9f27-3c4d9e7a1f0a service nova] Creating event network-vif-deleted:eb413b89-0802-48ea-b284-5887873ea6fc for instance 24944267-7f97-4622-827f-96f9b2e100e5 on hv-cinder-80390 Aug 10 05:23:42.293722 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-2b34b39a-79a2-47ac-b0b7-498e89e0a6f0 req-61d85447-a089-4bc0-9f27-3c4d9e7a1f0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057095 Aug 10 05:23:42.295095 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 467/930] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:23:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:42.532923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:42.533930 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] [instance: 766cb709-769b-418b-ad7e-d2360a7f57e8] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:42.540496 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:42.541189 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:42.542139 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:42.542867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:42.569643 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] HTTP exception thrown: Instance 766cb709-769b-418b-ad7e-d2360a7f57e8 could not be found. Aug 10 05:23:42.576667 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Returning 404 to user: Instance 766cb709-769b-418b-ad7e-d2360a7f57e8 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:23:42.576667 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-415e03f4-1dcf-459f-8126-2893c526f05f tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8" status: 404 len: 111 microversion: 2.1 time: 0.042868 Aug 10 05:23:42.576667 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 464/931] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:42 2021] GET /compute/v2.1/servers/766cb709-769b-418b-ad7e-d2360a7f57e8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:23:42.839089 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3ec21588-fe57-44bf-8390-c6cacdf078c1 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] Calling method '.version_select at 0x7fb33c3bfee0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:42.950202 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3ec21588-fe57-44bf-8390-c6cacdf078c1 tempest-TestShelveInstance-2043550347 tempest-TestShelveInstance-2043550347-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1485416630" status: 202 len: 0 microversion: 2.1 time: 0.133022 Aug 10 05:23:42.950852 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 468/932] 10.222.0.16 () {58 vars in 1254 bytes} [Tue Aug 10 05:23:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1485416630 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:23:43.252490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:43.253100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 24944267-7f97-4622-827f-96f9b2e100e5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:43.259289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:43.259759 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:43.260648 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:43.261248 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:43.283364 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] HTTP exception thrown: Instance 24944267-7f97-4622-827f-96f9b2e100e5 could not be found. Aug 10 05:23:43.284607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Returning 404 to user: Instance 24944267-7f97-4622-827f-96f9b2e100e5 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:23:43.286194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5a72252e-2c46-4dd1-95bb-b3298ba1e674 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5" status: 404 len: 111 microversion: 2.1 time: 0.037404 Aug 10 05:23:43.287504 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 465/933] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:43 2021] GET /compute/v2.1/servers/24944267-7f97-4622-827f-96f9b2e100e5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:23:44.615794 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4dbb1b59-37da-45e0-bbf5-fadddf6aa4e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:44.618570 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4dbb1b59-37da-45e0-bbf5-fadddf6aa4e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:44.629959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4dbb1b59-37da-45e0-bbf5-fadddf6aa4e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:44.630845 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4dbb1b59-37da-45e0-bbf5-fadddf6aa4e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:44.633315 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4dbb1b59-37da-45e0-bbf5-fadddf6aa4e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:44.633953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4dbb1b59-37da-45e0-bbf5-fadddf6aa4e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:44.683606 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4dbb1b59-37da-45e0-bbf5-fadddf6aa4e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:23:45.003959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4dbb1b59-37da-45e0-bbf5-fadddf6aa4e0 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 204 len: 0 microversion: 2.1 time: 0.392578 Aug 10 05:23:45.004683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 469/934] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:23:44 2021] DELETE /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:23:45.013142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b68f5808-78a1-4f2e-b168-83004593c28f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:45.014327 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b68f5808-78a1-4f2e-b168-83004593c28f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:45.022945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b68f5808-78a1-4f2e-b168-83004593c28f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:45.023193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b68f5808-78a1-4f2e-b168-83004593c28f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:45.023993 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b68f5808-78a1-4f2e-b168-83004593c28f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:45.024422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b68f5808-78a1-4f2e-b168-83004593c28f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:45.198396 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b68f5808-78a1-4f2e-b168-83004593c28f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:45.206101 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b68f5808-78a1-4f2e-b168-83004593c28f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1512 microversion: 2.1 time: 0.197127 Aug 10 05:23:45.207283 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 466/935] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:45 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:46.224738 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-6521555d-18d3-45fd-9e4a-c731d8081056 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:46.225976 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-6521555d-18d3-45fd-9e4a-c731d8081056 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:46.232013 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6521555d-18d3-45fd-9e4a-c731d8081056 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:46.232463 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6521555d-18d3-45fd-9e4a-c731d8081056 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:46.233238 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6521555d-18d3-45fd-9e4a-c731d8081056 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:46.233677 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-6521555d-18d3-45fd-9e4a-c731d8081056 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:46.643261 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-6521555d-18d3-45fd-9e4a-c731d8081056 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:46.652603 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-6521555d-18d3-45fd-9e4a-c731d8081056 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1512 microversion: 2.1 time: 0.431525 Aug 10 05:23:46.653060 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 470/936] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:46 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:47.560651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-dfd73142-3dd6-4ca1-bd8b-d57bf982458b req-b1757552-f58f-4819-a432-d5b2b90b7469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3e6b10-eede-4911-9bea-d800ff402647", "name": "network-vif-deleted", "tag": "304079a1-545e-4f7f-8eeb-0d648ab15a99"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:47.560651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:23:47.560651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:23:47.566763 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-dfd73142-3dd6-4ca1-bd8b-d57bf982458b req-b1757552-f58f-4819-a432-d5b2b90b7469 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:47.567211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-dfd73142-3dd6-4ca1-bd8b-d57bf982458b req-b1757552-f58f-4819-a432-d5b2b90b7469 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:47.580031 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-dfd73142-3dd6-4ca1-bd8b-d57bf982458b req-b1757552-f58f-4819-a432-d5b2b90b7469 service nova] Creating event network-vif-deleted:304079a1-545e-4f7f-8eeb-0d648ab15a99 for instance 6d3e6b10-eede-4911-9bea-d800ff402647 on hv-cinder-80390 Aug 10 05:23:47.585441 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-dfd73142-3dd6-4ca1-bd8b-d57bf982458b req-b1757552-f58f-4819-a432-d5b2b90b7469 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032494 Aug 10 05:23:47.586224 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 467/937] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:23:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:47.670681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1954ac0c-81c2-4089-b7be-5746f73e141e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:47.674668 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1954ac0c-81c2-4089-b7be-5746f73e141e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:47.694868 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1954ac0c-81c2-4089-b7be-5746f73e141e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:47.695394 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1954ac0c-81c2-4089-b7be-5746f73e141e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:47.696247 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1954ac0c-81c2-4089-b7be-5746f73e141e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:47.696935 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1954ac0c-81c2-4089-b7be-5746f73e141e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:47.838034 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-1954ac0c-81c2-4089-b7be-5746f73e141e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:47.845722 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1954ac0c-81c2-4089-b7be-5746f73e141e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 200 len: 1470 microversion: 2.1 time: 0.179974 Aug 10 05:23:47.849177 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 471/938] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:47 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:23:48.864035 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:48.866094 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 6d3e6b10-eede-4911-9bea-d800ff402647] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:48.871955 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:48.872370 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:48.873151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:48.873588 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:48.897501 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] HTTP exception thrown: Instance 6d3e6b10-eede-4911-9bea-d800ff402647 could not be found. Aug 10 05:23:48.898101 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Returning 404 to user: Instance 6d3e6b10-eede-4911-9bea-d800ff402647 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:23:48.898971 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-35ae88d0-5248-4c81-abea-dbbb5d8692a7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647" status: 404 len: 111 microversion: 2.1 time: 0.039353 Aug 10 05:23:48.899520 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 468/939] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:48 2021] GET /compute/v2.1/servers/6d3e6b10-eede-4911-9bea-d800ff402647 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:23:48.907492 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ef8f259c-8d90-4f2b-87ed-b63ae3417d86 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:48.908155 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ef8f259c-8d90-4f2b-87ed-b63ae3417d86 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:48.914617 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ef8f259c-8d90-4f2b-87ed-b63ae3417d86 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:48.915140 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ef8f259c-8d90-4f2b-87ed-b63ae3417d86 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:48.915979 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ef8f259c-8d90-4f2b-87ed-b63ae3417d86 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:48.916485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ef8f259c-8d90-4f2b-87ed-b63ae3417d86 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:48.941862 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ef8f259c-8d90-4f2b-87ed-b63ae3417d86 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:23:49.260350 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ef8f259c-8d90-4f2b-87ed-b63ae3417d86 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 204 len: 0 microversion: 2.1 time: 0.356188 Aug 10 05:23:49.261068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 472/940] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:23:48 2021] DELETE /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:23:49.269691 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ad6d3827-2eca-4bf9-baf1-ea304c102fe3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:49.270321 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ad6d3827-2eca-4bf9-baf1-ea304c102fe3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:49.277337 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad6d3827-2eca-4bf9-baf1-ea304c102fe3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:49.277782 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad6d3827-2eca-4bf9-baf1-ea304c102fe3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:49.278552 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad6d3827-2eca-4bf9-baf1-ea304c102fe3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:49.279004 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad6d3827-2eca-4bf9-baf1-ea304c102fe3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:49.403439 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ad6d3827-2eca-4bf9-baf1-ea304c102fe3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:49.411649 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ad6d3827-2eca-4bf9-baf1-ea304c102fe3 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1513 microversion: 2.1 time: 0.145702 Aug 10 05:23:49.414411 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 469/941] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:49 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:23:50.432197 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-73b53917-38f4-4c9a-b0f2-d53c17602a8f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:50.432956 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-73b53917-38f4-4c9a-b0f2-d53c17602a8f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:50.439540 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-73b53917-38f4-4c9a-b0f2-d53c17602a8f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:50.439996 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-73b53917-38f4-4c9a-b0f2-d53c17602a8f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:50.440874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-73b53917-38f4-4c9a-b0f2-d53c17602a8f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:50.444749 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-73b53917-38f4-4c9a-b0f2-d53c17602a8f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:50.744804 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-73b53917-38f4-4c9a-b0f2-d53c17602a8f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:50.753759 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-73b53917-38f4-4c9a-b0f2-d53c17602a8f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1513 microversion: 2.1 time: 0.327539 Aug 10 05:23:50.764224 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 473/942] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:50 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1513 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:51.771900 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ab367ae9-bc2d-4e63-ae1c-15dc6375a7e5 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:51.772506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ab367ae9-bc2d-4e63-ae1c-15dc6375a7e5 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:51.784623 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ab367ae9-bc2d-4e63-ae1c-15dc6375a7e5 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:51.785439 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ab367ae9-bc2d-4e63-ae1c-15dc6375a7e5 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:51.786275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ab367ae9-bc2d-4e63-ae1c-15dc6375a7e5 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:51.786742 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ab367ae9-bc2d-4e63-ae1c-15dc6375a7e5 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:52.035948 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ab367ae9-bc2d-4e63-ae1c-15dc6375a7e5 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:52.047069 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ab367ae9-bc2d-4e63-ae1c-15dc6375a7e5 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1513 microversion: 2.1 time: 0.278780 Aug 10 05:23:52.047946 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 470/943] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:51 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:52.208019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-d3a3065a-62ad-4d2a-a861-44efbe082aa0 req-58863816-f579-4d93-971f-677f3ed20c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "675cc748-f393-42c3-a063-f7fa2547a2e0", "name": "network-vif-deleted", "tag": "a29b4f8f-eb94-4996-a605-788549f47ee7"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:52.210709 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:23:52.210709 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:23:52.220610 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-d3a3065a-62ad-4d2a-a861-44efbe082aa0 req-58863816-f579-4d93-971f-677f3ed20c4d service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:52.227385 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-d3a3065a-62ad-4d2a-a861-44efbe082aa0 req-58863816-f579-4d93-971f-677f3ed20c4d service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:52.243790 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-d3a3065a-62ad-4d2a-a861-44efbe082aa0 req-58863816-f579-4d93-971f-677f3ed20c4d service nova] Creating event network-vif-deleted:a29b4f8f-eb94-4996-a605-788549f47ee7 for instance 675cc748-f393-42c3-a063-f7fa2547a2e0 on hv-cinder-80390 Aug 10 05:23:52.257413 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-d3a3065a-62ad-4d2a-a861-44efbe082aa0 req-58863816-f579-4d93-971f-677f3ed20c4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052450 Aug 10 05:23:52.259233 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 474/944] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:23:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:53.064966 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:53.065717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:53.078835 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:53.079473 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:53.081538 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:53.082150 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:53.124379 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:53.125038 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:53.125649 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lazy-loading 'fault' on Instance uuid 675cc748-f393-42c3-a063-f7fa2547a2e0 {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:23:53.215198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:53.233558 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-201845e9-e91e-4093-b6d1-24dc1f3446e7 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 200 len: 1307 microversion: 2.1 time: 0.172544 Aug 10 05:23:53.236049 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 471/945] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:53 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:54.251806 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:54.253121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 675cc748-f393-42c3-a063-f7fa2547a2e0] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:54.264276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:54.264739 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:54.266926 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:54.270267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:54.314856 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] HTTP exception thrown: Instance 675cc748-f393-42c3-a063-f7fa2547a2e0 could not be found. Aug 10 05:23:54.319529 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Returning 404 to user: Instance 675cc748-f393-42c3-a063-f7fa2547a2e0 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:23:54.320832 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-1a704846-016c-4055-9057-28d6fb726ca6 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0" status: 404 len: 111 microversion: 2.1 time: 0.073468 Aug 10 05:23:54.322023 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 475/946] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:54 2021] GET /compute/v2.1/servers/675cc748-f393-42c3-a063-f7fa2547a2e0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:23:55.666729 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-27da0752-200b-437f-a202-2c3e1fc942aa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:55.667213 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-27da0752-200b-437f-a202-2c3e1fc942aa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:55.682289 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-27da0752-200b-437f-a202-2c3e1fc942aa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:55.684531 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-27da0752-200b-437f-a202-2c3e1fc942aa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:55.684531 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-27da0752-200b-437f-a202-2c3e1fc942aa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:55.684531 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-27da0752-200b-437f-a202-2c3e1fc942aa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:55.721168 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-27da0752-200b-437f-a202-2c3e1fc942aa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Going to try to terminate instance {{(pid=108137) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:23:56.050359 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-27da0752-200b-437f-a202-2c3e1fc942aa tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 204 len: 0 microversion: 2.1 time: 0.386712 Aug 10 05:23:56.051544 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 472/947] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:23:55 2021] DELETE /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:23:56.060333 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-67c424f5-39bc-43b0-96e4-1cd207f01aef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:56.061084 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-67c424f5-39bc-43b0-96e4-1cd207f01aef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:56.071207 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-67c424f5-39bc-43b0-96e4-1cd207f01aef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:56.071896 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-67c424f5-39bc-43b0-96e4-1cd207f01aef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:56.074173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-67c424f5-39bc-43b0-96e4-1cd207f01aef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:56.075185 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-67c424f5-39bc-43b0-96e4-1cd207f01aef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:56.316447 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-67c424f5-39bc-43b0-96e4-1cd207f01aef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:56.326606 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-67c424f5-39bc-43b0-96e4-1cd207f01aef tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1511 microversion: 2.1 time: 0.269468 Aug 10 05:23:56.327626 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 476/948] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:56 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:57.353304 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-18d469ee-afcb-4cd0-8cc2-6e0e8823634f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:57.354010 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-18d469ee-afcb-4cd0-8cc2-6e0e8823634f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:57.359918 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-18d469ee-afcb-4cd0-8cc2-6e0e8823634f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:57.360650 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-18d469ee-afcb-4cd0-8cc2-6e0e8823634f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:57.361416 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-18d469ee-afcb-4cd0-8cc2-6e0e8823634f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:57.361846 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-18d469ee-afcb-4cd0-8cc2-6e0e8823634f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:57.486566 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-18d469ee-afcb-4cd0-8cc2-6e0e8823634f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:57.494293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-18d469ee-afcb-4cd0-8cc2-6e0e8823634f tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1511 microversion: 2.1 time: 0.145089 Aug 10 05:23:57.494877 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 473/949] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:57 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1511 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:23:58.483034 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-ce136694-2166-4655-a25f-dfa2211fbcb0 req-d67b3a97-7244-4247-b171-4dc84772a04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5", "name": "network-vif-deleted", "tag": "8ddaee6c-67a4-46bd-a614-ad1bb584f581"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:23:58.489483 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:23:58.489483 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:23:58.491860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-ce136694-2166-4655-a25f-dfa2211fbcb0 req-d67b3a97-7244-4247-b171-4dc84772a04d service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:58.492313 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-ce136694-2166-4655-a25f-dfa2211fbcb0 req-d67b3a97-7244-4247-b171-4dc84772a04d service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:58.504037 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-ce136694-2166-4655-a25f-dfa2211fbcb0 req-d67b3a97-7244-4247-b171-4dc84772a04d service nova] Creating event network-vif-deleted:8ddaee6c-67a4-46bd-a614-ad1bb584f581 for instance 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 on hv-cinder-80390 Aug 10 05:23:58.510033 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-ce136694-2166-4655-a25f-dfa2211fbcb0 req-d67b3a97-7244-4247-b171-4dc84772a04d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030395 Aug 10 05:23:58.511177 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 477/950] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:23:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:23:58.514041 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f3982b01-9faf-4e95-a9be-cd4b73cf3315 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:58.514477 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f3982b01-9faf-4e95-a9be-cd4b73cf3315 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:58.521026 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f3982b01-9faf-4e95-a9be-cd4b73cf3315 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:58.522361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f3982b01-9faf-4e95-a9be-cd4b73cf3315 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:58.523425 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f3982b01-9faf-4e95-a9be-cd4b73cf3315 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:58.524084 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f3982b01-9faf-4e95-a9be-cd4b73cf3315 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:58.603025 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f3982b01-9faf-4e95-a9be-cd4b73cf3315 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7021089fd78c4c70b303877e71bc6215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e88b565f34674a368e054f0a19cd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:23:58.615964 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f3982b01-9faf-4e95-a9be-cd4b73cf3315 tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 200 len: 1469 microversion: 2.1 time: 0.108260 Aug 10 05:23:58.626293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 474/951] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:58 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 1469 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:23:59.633665 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:23:59.634368 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] [instance: 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:23:59.641073 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:59.641532 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:59.642313 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:23:59.642787 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:23:59.655985 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] HTTP exception thrown: Instance 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 could not be found. Aug 10 05:23:59.656578 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] Returning 404 to user: Instance 2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:23:59.657797 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-34bd21f7-d2b0-456f-b67a-9a8bc789f00e tempest-AttachVolumeNegativeTest-999704672 tempest-AttachVolumeNegativeTest-999704672-project] 10.222.0.16 "GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5" status: 404 len: 111 microversion: 2.1 time: 0.028323 Aug 10 05:23:59.662279 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 478/952] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:23:59 2021] GET /compute/v2.1/servers/2ab89d70-49d1-4dd8-bf9d-5eb0c89a2fe5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:24:02.549628 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a11fefc6-03c0-4f46-aafe-33c7bbb8ea27 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] Action: 'create', calling method: .version_select at 0x7fb33c3b9670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-768048793", "metadata": {"Type": "work"}}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:03.196020 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a11fefc6-03c0-4f46-aafe-33c7bbb8ea27 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.777322 Aug 10 05:24:03.202756 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 475/953] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Aug 10 05:24:02 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 785 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 05:24:03.208021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bb7ed018-cb0c-4b5e-8057-c36b85142800 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] Calling method '.version_select at 0x7fb33c41d1f0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:03.276105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bb7ed018-cb0c-4b5e-8057-c36b85142800 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386" status: 200 len: 352 microversion: 2.1 time: 0.072124 Aug 10 05:24:03.276683 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 479/954] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:24:03 2021] GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:04.289455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3e0c8077-468b-46ab-84bd-e5dc155d14a1 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] Calling method '.version_select at 0x7fb33c430a60>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:04.349721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3e0c8077-468b-46ab-84bd-e5dc155d14a1 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386" status: 200 len: 353 microversion: 2.1 time: 0.064000 Aug 10 05:24:04.350299 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 476/955] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:24:04 2021] GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:04.361206 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-78a8f75a-58b4-41cb-bbde-0d33c568053b tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] Calling method '.version_select at 0x7fb33c430280>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:04.416587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-78a8f75a-58b4-41cb-bbde-0d33c568053b tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386" status: 200 len: 353 microversion: 2.1 time: 0.059246 Aug 10 05:24:04.417181 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 480/956] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:24:04 2021] GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:24:04.432833 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e99d80f6-1316-4c59-bece-a0e66bfd4971 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] Calling method '.version_select at 0x7fb33c4025e0>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:04.654462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e99d80f6-1316-4c59-bece-a0e66bfd4971 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386" status: 202 len: 0 microversion: 2.1 time: 0.225155 Aug 10 05:24:04.655181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 477/957] 10.222.0.16 () {58 vars in 1248 bytes} [Tue Aug 10 05:24:04 2021] DELETE /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:24:04.663263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-311f686c-ebb4-4aa0-897d-7585aff65a33 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] Calling method '.version_select at 0x7fb33c3bf3a0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:04.715517 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-311f686c-ebb4-4aa0-897d-7585aff65a33 tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386" status: 200 len: 352 microversion: 2.1 time: 0.056021 Aug 10 05:24:04.716206 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 481/958] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:24:04 2021] GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:04.751506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-0774d6bc-cc93-4c7f-8f9e-6e666eb020b7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Action: 'create', calling method: .version_select at 0x7fb33c402d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1527843142"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:04.769243 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-0774d6bc-cc93-4c7f-8f9e-6e666eb020b7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Getting quotas for project ea6a28118fed4568a62deb8f8326a3ce. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:24:04.773755 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-0774d6bc-cc93-4c7f-8f9e-6e666eb020b7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Getting quotas for user 5b1ae97ac20846f98584751422f8373b and project ea6a28118fed4568a62deb8f8326a3ce. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:24:05.108273 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-0774d6bc-cc93-4c7f-8f9e-6e666eb020b7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Getting quotas for project ea6a28118fed4568a62deb8f8326a3ce. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:24:05.112191 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-0774d6bc-cc93-4c7f-8f9e-6e666eb020b7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Getting quotas for user 5b1ae97ac20846f98584751422f8373b and project ea6a28118fed4568a62deb8f8326a3ce. Resources: {'key_pairs'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:24:05.124974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-0774d6bc-cc93-4c7f-8f9e-6e666eb020b7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.377289 Aug 10 05:24:05.125619 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 478/959] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Aug 10 05:24:04 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:05.219645 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1616562236", "imageRef": "f5ebf704-9198-4d45-bc26-7aea66beee51", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1527843142", "networks": [{"uuid": "c1a64c26-709c-48b3-8c3f-46533ced83fc"}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:05.268226 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] validate_networks() for [('c1a64c26-709c-48b3-8c3f-46533ced83fc', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:24:05.623795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:24:05.624350 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:24:05.624686 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:24:05.625096 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:24:05.625510 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:24:05.634649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:05.635034 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:05.635840 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:05.636271 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:05.653144 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Getting quotas for project ea6a28118fed4568a62deb8f8326a3ce. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:24:05.657040 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Getting quotas for user 5b1ae97ac20846f98584751422f8373b and project ea6a28118fed4568a62deb8f8326a3ce. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:24:05.667529 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:24:05.669733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5ebf704-9198-4d45-bc26-7aea66beee51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:24:05.728060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4eb234d9-b464-4d22-b23f-6124091e341e tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] Calling method '.version_select at 0x7fb33c3b9af0>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:05.755819 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-4eb234d9-b464-4d22-b23f-6124091e341e tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] HTTP exception thrown: Volume 1a160711-3b21-4e33-8b00-fadd16c6a386 could not be found. Aug 10 05:24:05.756449 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4eb234d9-b464-4d22-b23f-6124091e341e tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] Returning 404 to user: Volume 1a160711-3b21-4e33-8b00-fadd16c6a386 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:24:05.757383 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4eb234d9-b464-4d22-b23f-6124091e341e tempest-VolumesGetTestJSON-614751506 tempest-VolumesGetTestJSON-614751506-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386" status: 404 len: 109 microversion: 2.1 time: 0.033172 Aug 10 05:24:05.757935 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 479/960] 10.222.0.16 () {58 vars in 1245 bytes} [Tue Aug 10 05:24:05 2021] GET /compute/v2.1/os-volumes/1a160711-3b21-4e33-8b00-fadd16c6a386 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 05:24:05.803051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0a2f5c4e-f091-4566-8a0d-775ff2b76967 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586942 Aug 10 05:24:05.803707 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 482/961] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:24:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:24:05.813412 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3e962009-b55f-4245-bdcc-99c71721e7df tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:05.814721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3e962009-b55f-4245-bdcc-99c71721e7df tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:05.874296 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3e962009-b55f-4245-bdcc-99c71721e7df tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:05.881461 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3e962009-b55f-4245-bdcc-99c71721e7df tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1259 microversion: 2.1 time: 0.071800 Aug 10 05:24:05.882018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 480/962] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:05 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:06.898844 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a03a0875-f07c-4ca1-a8af-17ce09c63599 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:06.899459 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a03a0875-f07c-4ca1-a8af-17ce09c63599 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:06.905517 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a03a0875-f07c-4ca1-a8af-17ce09c63599 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:06.905967 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a03a0875-f07c-4ca1-a8af-17ce09c63599 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:06.911345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a03a0875-f07c-4ca1-a8af-17ce09c63599 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:06.911345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a03a0875-f07c-4ca1-a8af-17ce09c63599 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:06.970075 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a03a0875-f07c-4ca1-a8af-17ce09c63599 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:06.977336 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a03a0875-f07c-4ca1-a8af-17ce09c63599 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1263 microversion: 2.1 time: 0.083424 Aug 10 05:24:06.977883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 483/963] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:06 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:24:07.994506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b5454c2b-b7d3-44ed-b7b9-606cc3691bb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:07.995141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b5454c2b-b7d3-44ed-b7b9-606cc3691bb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:08.001025 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b5454c2b-b7d3-44ed-b7b9-606cc3691bb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:08.001481 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b5454c2b-b7d3-44ed-b7b9-606cc3691bb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:08.002254 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b5454c2b-b7d3-44ed-b7b9-606cc3691bb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:08.002722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b5454c2b-b7d3-44ed-b7b9-606cc3691bb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:08.066137 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b5454c2b-b7d3-44ed-b7b9-606cc3691bb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:08.073305 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b5454c2b-b7d3-44ed-b7b9-606cc3691bb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1311 microversion: 2.1 time: 0.082437 Aug 10 05:24:08.073883 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 481/964] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:07 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:09.094364 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-784c3655-fffb-4444-86ff-d93c40bc7900 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:09.095016 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-784c3655-fffb-4444-86ff-d93c40bc7900 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:09.101356 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-784c3655-fffb-4444-86ff-d93c40bc7900 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:09.101841 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-784c3655-fffb-4444-86ff-d93c40bc7900 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:09.102745 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-784c3655-fffb-4444-86ff-d93c40bc7900 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:09.103263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-784c3655-fffb-4444-86ff-d93c40bc7900 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:09.248286 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-784c3655-fffb-4444-86ff-d93c40bc7900 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:09.257002 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-784c3655-fffb-4444-86ff-d93c40bc7900 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.166795 Aug 10 05:24:09.257675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 484/965] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:09 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:10.274947 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-424435e7-60e0-4939-b305-3b659cbf19c5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:10.275557 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-424435e7-60e0-4939-b305-3b659cbf19c5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:10.281908 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-424435e7-60e0-4939-b305-3b659cbf19c5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:10.282471 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-424435e7-60e0-4939-b305-3b659cbf19c5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:10.283501 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-424435e7-60e0-4939-b305-3b659cbf19c5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:10.283945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-424435e7-60e0-4939-b305-3b659cbf19c5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:10.324436 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-436aadf9-361a-4814-ad5f-c3437868e3f6 req-f0038527-f2e8-4462-8c96-5440e2c2ae9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511b4fd6-05af-42c8-b691-4926486f6f50", "tag": "076ea264-6ca7-4640-a5cc-e7faa9876c93"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:10.326090 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:24:10.326090 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:24:10.334615 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-436aadf9-361a-4814-ad5f-c3437868e3f6 req-f0038527-f2e8-4462-8c96-5440e2c2ae9e service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:10.334981 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-436aadf9-361a-4814-ad5f-c3437868e3f6 req-f0038527-f2e8-4462-8c96-5440e2c2ae9e service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:10.354565 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-436aadf9-361a-4814-ad5f-c3437868e3f6 req-f0038527-f2e8-4462-8c96-5440e2c2ae9e service nova] Creating event network-changed:076ea264-6ca7-4640-a5cc-e7faa9876c93 for instance 511b4fd6-05af-42c8-b691-4926486f6f50 on hv-cinder-80390 Aug 10 05:24:10.360485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-436aadf9-361a-4814-ad5f-c3437868e3f6 req-f0038527-f2e8-4462-8c96-5440e2c2ae9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040179 Aug 10 05:24:10.361245 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 485/966] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:24:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:10.504410 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-424435e7-60e0-4939-b305-3b659cbf19c5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:10.512038 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-424435e7-60e0-4939-b305-3b659cbf19c5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.241265 Aug 10 05:24:10.512620 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 482/967] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:10 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:11.531243 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ae58a3ce-b58c-4416-bb0f-7248b6aca78b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:11.532613 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ae58a3ce-b58c-4416-bb0f-7248b6aca78b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:11.539749 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae58a3ce-b58c-4416-bb0f-7248b6aca78b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:11.540200 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae58a3ce-b58c-4416-bb0f-7248b6aca78b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:11.540977 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae58a3ce-b58c-4416-bb0f-7248b6aca78b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:11.541405 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ae58a3ce-b58c-4416-bb0f-7248b6aca78b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:11.669096 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ae58a3ce-b58c-4416-bb0f-7248b6aca78b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:11.676620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ae58a3ce-b58c-4416-bb0f-7248b6aca78b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.150030 Aug 10 05:24:11.677846 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 486/968] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:11 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:24:12.701506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ce755b70-71a1-4a15-a280-fc5c435f0f14 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:12.702765 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ce755b70-71a1-4a15-a280-fc5c435f0f14 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:12.709307 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce755b70-71a1-4a15-a280-fc5c435f0f14 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:12.710010 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce755b70-71a1-4a15-a280-fc5c435f0f14 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:12.711124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce755b70-71a1-4a15-a280-fc5c435f0f14 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:12.711723 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce755b70-71a1-4a15-a280-fc5c435f0f14 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:12.853114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ce755b70-71a1-4a15-a280-fc5c435f0f14 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:12.862802 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ce755b70-71a1-4a15-a280-fc5c435f0f14 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.164856 Aug 10 05:24:12.863633 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 483/969] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:12 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:13.880618 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0559bd9d-81e2-4f41-a68a-01b17743f663 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:13.881157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0559bd9d-81e2-4f41-a68a-01b17743f663 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:13.887463 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0559bd9d-81e2-4f41-a68a-01b17743f663 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:13.888063 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0559bd9d-81e2-4f41-a68a-01b17743f663 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:13.889139 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0559bd9d-81e2-4f41-a68a-01b17743f663 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:13.889884 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0559bd9d-81e2-4f41-a68a-01b17743f663 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:14.013968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0559bd9d-81e2-4f41-a68a-01b17743f663 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:14.023840 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0559bd9d-81e2-4f41-a68a-01b17743f663 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.146775 Aug 10 05:24:14.024461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 487/970] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:13 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:15.041437 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-02cc186e-1340-4a98-a059-a483d51a2bbb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:15.042315 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-02cc186e-1340-4a98-a059-a483d51a2bbb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:15.049222 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-02cc186e-1340-4a98-a059-a483d51a2bbb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:15.049791 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-02cc186e-1340-4a98-a059-a483d51a2bbb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:15.050744 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-02cc186e-1340-4a98-a059-a483d51a2bbb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:15.051283 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-02cc186e-1340-4a98-a059-a483d51a2bbb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:15.177348 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-02cc186e-1340-4a98-a059-a483d51a2bbb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:15.184568 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-02cc186e-1340-4a98-a059-a483d51a2bbb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.146920 Aug 10 05:24:15.185130 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 484/971] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:15 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:16.201496 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0d071b30-7345-424b-aa16-e8894ade71cb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:16.202139 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0d071b30-7345-424b-aa16-e8894ade71cb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:16.208056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0d071b30-7345-424b-aa16-e8894ade71cb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:16.208506 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0d071b30-7345-424b-aa16-e8894ade71cb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:16.209269 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0d071b30-7345-424b-aa16-e8894ade71cb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:16.209702 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0d071b30-7345-424b-aa16-e8894ade71cb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:16.343379 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0d071b30-7345-424b-aa16-e8894ade71cb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:16.351334 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0d071b30-7345-424b-aa16-e8894ade71cb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.153617 Aug 10 05:24:16.351907 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 488/972] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:16 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:17.366210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 05:24:17.370423 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ac5d5fbc-2f63-413b-ab09-d0b5b3da1e77 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:17.371127 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ac5d5fbc-2f63-413b-ab09-d0b5b3da1e77 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:17.387570 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac5d5fbc-2f63-413b-ab09-d0b5b3da1e77 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:17.388024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac5d5fbc-2f63-413b-ab09-d0b5b3da1e77 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:17.388810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac5d5fbc-2f63-413b-ab09-d0b5b3da1e77 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:17.389269 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ac5d5fbc-2f63-413b-ab09-d0b5b3da1e77 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:17.515650 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ac5d5fbc-2f63-413b-ab09-d0b5b3da1e77 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:17.523307 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ac5d5fbc-2f63-413b-ab09-d0b5b3da1e77 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.159005 Aug 10 05:24:17.524810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 485/973] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:17 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:18.541812 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0e896c90-f5c6-4cc4-873e-c795d4b3f91f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:18.543259 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0e896c90-f5c6-4cc4-873e-c795d4b3f91f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:18.550011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0e896c90-f5c6-4cc4-873e-c795d4b3f91f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:18.550851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0e896c90-f5c6-4cc4-873e-c795d4b3f91f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:18.552056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0e896c90-f5c6-4cc4-873e-c795d4b3f91f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:18.552734 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0e896c90-f5c6-4cc4-873e-c795d4b3f91f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:18.673955 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0e896c90-f5c6-4cc4-873e-c795d4b3f91f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:18.681718 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0e896c90-f5c6-4cc4-873e-c795d4b3f91f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.143865 Aug 10 05:24:18.682282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 489/974] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:18 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:19.698565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d41d90cd-e0d7-485b-a98b-2965b18e2f1a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:19.699227 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d41d90cd-e0d7-485b-a98b-2965b18e2f1a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:19.716360 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d41d90cd-e0d7-485b-a98b-2965b18e2f1a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:19.716818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d41d90cd-e0d7-485b-a98b-2965b18e2f1a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:19.717600 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d41d90cd-e0d7-485b-a98b-2965b18e2f1a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:19.718040 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d41d90cd-e0d7-485b-a98b-2965b18e2f1a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:19.723248 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60036. Aug 10 05:24:19.845372 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d41d90cd-e0d7-485b-a98b-2965b18e2f1a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:19.852933 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d41d90cd-e0d7-485b-a98b-2965b18e2f1a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.157918 Aug 10 05:24:19.855180 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 486/975] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:19 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:20.872041 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d31c3ac3-cab6-4bf4-acbb-19a382e6584c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:20.872688 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d31c3ac3-cab6-4bf4-acbb-19a382e6584c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:20.878524 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d31c3ac3-cab6-4bf4-acbb-19a382e6584c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:20.878993 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d31c3ac3-cab6-4bf4-acbb-19a382e6584c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:20.879757 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d31c3ac3-cab6-4bf4-acbb-19a382e6584c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:20.880195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d31c3ac3-cab6-4bf4-acbb-19a382e6584c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:21.002528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d31c3ac3-cab6-4bf4-acbb-19a382e6584c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:21.010685 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d31c3ac3-cab6-4bf4-acbb-19a382e6584c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.142334 Aug 10 05:24:21.019778 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 490/976] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:20 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:22.026924 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d0fb8e21-1132-4cf8-9a1c-a9eeedf8d2e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:22.027541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d0fb8e21-1132-4cf8-9a1c-a9eeedf8d2e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:22.033635 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d0fb8e21-1132-4cf8-9a1c-a9eeedf8d2e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:22.035008 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d0fb8e21-1132-4cf8-9a1c-a9eeedf8d2e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:22.035008 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d0fb8e21-1132-4cf8-9a1c-a9eeedf8d2e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:22.035331 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d0fb8e21-1132-4cf8-9a1c-a9eeedf8d2e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:22.157125 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d0fb8e21-1132-4cf8-9a1c-a9eeedf8d2e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:22.164890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d0fb8e21-1132-4cf8-9a1c-a9eeedf8d2e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.141618 Aug 10 05:24:22.165559 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 487/977] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:22 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:23.181274 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f52b5ff2-1faa-4a2b-a603-359e8c31532f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:23.181892 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f52b5ff2-1faa-4a2b-a603-359e8c31532f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:23.187585 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f52b5ff2-1faa-4a2b-a603-359e8c31532f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:23.188038 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f52b5ff2-1faa-4a2b-a603-359e8c31532f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:23.188805 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f52b5ff2-1faa-4a2b-a603-359e8c31532f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:23.189389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f52b5ff2-1faa-4a2b-a603-359e8c31532f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:23.306752 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f52b5ff2-1faa-4a2b-a603-359e8c31532f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:23.314113 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f52b5ff2-1faa-4a2b-a603-359e8c31532f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.136669 Aug 10 05:24:23.315002 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 491/978] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:23 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:24.329701 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-df01440c-9176-4978-8366-a60fe4569726 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:24.330323 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-df01440c-9176-4978-8366-a60fe4569726 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:24.336270 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df01440c-9176-4978-8366-a60fe4569726 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:24.336728 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df01440c-9176-4978-8366-a60fe4569726 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:24.337508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df01440c-9176-4978-8366-a60fe4569726 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:24.337950 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-df01440c-9176-4978-8366-a60fe4569726 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:24.456122 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-df01440c-9176-4978-8366-a60fe4569726 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:24.464113 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-df01440c-9176-4978-8366-a60fe4569726 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.138119 Aug 10 05:24:24.464669 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 488/979] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:24 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:25.480458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7ee2691a-d0e2-441b-9861-2fe289a2b49a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:25.481068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7ee2691a-d0e2-441b-9861-2fe289a2b49a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:25.491115 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ee2691a-d0e2-441b-9861-2fe289a2b49a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:25.491571 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ee2691a-d0e2-441b-9861-2fe289a2b49a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:25.492411 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ee2691a-d0e2-441b-9861-2fe289a2b49a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:25.492849 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7ee2691a-d0e2-441b-9861-2fe289a2b49a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:25.620763 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-7ee2691a-d0e2-441b-9861-2fe289a2b49a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:25.628454 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7ee2691a-d0e2-441b-9861-2fe289a2b49a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.151755 Aug 10 05:24:25.638326 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 492/980] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:25 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:26.645033 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d05d31a2-bcf0-40c9-ab80-bae11df80221 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:26.645672 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d05d31a2-bcf0-40c9-ab80-bae11df80221 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:26.652027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d05d31a2-bcf0-40c9-ab80-bae11df80221 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:26.652473 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d05d31a2-bcf0-40c9-ab80-bae11df80221 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:26.653235 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d05d31a2-bcf0-40c9-ab80-bae11df80221 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:26.653671 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d05d31a2-bcf0-40c9-ab80-bae11df80221 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:26.774105 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-d05d31a2-bcf0-40c9-ab80-bae11df80221 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:26.781533 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d05d31a2-bcf0-40c9-ab80-bae11df80221 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.140144 Aug 10 05:24:26.782087 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 489/981] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:26 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:27.297349 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-fb6de2e3-970c-43a1-9282-bde6db03b2af req-ba0d5ff9-c8c3-4a71-96b0-6a970d5e251c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511b4fd6-05af-42c8-b691-4926486f6f50", "name": "network-vif-plugged", "status": "completed", "tag": "076ea264-6ca7-4640-a5cc-e7faa9876c93"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:27.299097 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:24:27.299097 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:24:27.306662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-fb6de2e3-970c-43a1-9282-bde6db03b2af req-ba0d5ff9-c8c3-4a71-96b0-6a970d5e251c service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:27.310121 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-fb6de2e3-970c-43a1-9282-bde6db03b2af req-ba0d5ff9-c8c3-4a71-96b0-6a970d5e251c service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:27.317477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-fb6de2e3-970c-43a1-9282-bde6db03b2af req-ba0d5ff9-c8c3-4a71-96b0-6a970d5e251c service nova] Creating event network-vif-plugged:076ea264-6ca7-4640-a5cc-e7faa9876c93 for instance 511b4fd6-05af-42c8-b691-4926486f6f50 on hv-cinder-80390 Aug 10 05:24:27.322400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-fb6de2e3-970c-43a1-9282-bde6db03b2af req-ba0d5ff9-c8c3-4a71-96b0-6a970d5e251c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029168 Aug 10 05:24:27.322942 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 493/982] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:24:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:27.798301 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f34ba56a-9f41-48f9-8e5c-79e751631db7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:27.798959 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f34ba56a-9f41-48f9-8e5c-79e751631db7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:27.805104 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f34ba56a-9f41-48f9-8e5c-79e751631db7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:27.805565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f34ba56a-9f41-48f9-8e5c-79e751631db7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:27.806361 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f34ba56a-9f41-48f9-8e5c-79e751631db7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:27.806832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f34ba56a-9f41-48f9-8e5c-79e751631db7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:27.924591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f34ba56a-9f41-48f9-8e5c-79e751631db7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:27.931733 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f34ba56a-9f41-48f9-8e5c-79e751631db7 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1359 microversion: 2.1 time: 0.137221 Aug 10 05:24:27.932297 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 490/983] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:27 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1359 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:28.948620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-687f5da1-00af-4918-ab79-46c2652aaff5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:28.949361 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-687f5da1-00af-4918-ab79-46c2652aaff5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:28.955258 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-687f5da1-00af-4918-ab79-46c2652aaff5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:28.955710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-687f5da1-00af-4918-ab79-46c2652aaff5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:28.956472 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-687f5da1-00af-4918-ab79-46c2652aaff5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:28.956906 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-687f5da1-00af-4918-ab79-46c2652aaff5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:29.079478 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-687f5da1-00af-4918-ab79-46c2652aaff5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:29.087331 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-687f5da1-00af-4918-ab79-46c2652aaff5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1550 microversion: 2.1 time: 0.142746 Aug 10 05:24:29.087894 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 494/984] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:28 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1550 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:29.102658 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6fa4d484-ee22-4f96-b529-8ba6820bff5a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:29.103276 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6fa4d484-ee22-4f96-b529-8ba6820bff5a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:29.109186 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fa4d484-ee22-4f96-b529-8ba6820bff5a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:29.109639 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fa4d484-ee22-4f96-b529-8ba6820bff5a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:29.110771 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fa4d484-ee22-4f96-b529-8ba6820bff5a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:29.111248 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6fa4d484-ee22-4f96-b529-8ba6820bff5a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:29.230597 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6fa4d484-ee22-4f96-b529-8ba6820bff5a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:29.238093 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6fa4d484-ee22-4f96-b529-8ba6820bff5a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1550 microversion: 2.1 time: 0.139078 Aug 10 05:24:29.238672 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 491/985] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:29 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1550 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:29.253200 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:29.256589 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:24:29.256589 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:24:29.258073 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:29.258840 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Searching by: {'deleted': False, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce'} {{(pid=108136) get_all /opt/stack/nova/nova/compute/api.py:2833}} Aug 10 05:24:29.265394 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:29.265839 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:29.266695 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:29.271058 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:29.356238 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.multi_cell_list [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108136) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 10 05:24:29.448069 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8735494d-c0ae-4500-bd22-b3217d32df50 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198531 Aug 10 05:24:29.448646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 495/986] 10.222.0.16 () {58 vars in 1125 bytes} [Tue Aug 10 05:24:29 2021] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:29.458355 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-748e335b-894b-4612-8abd-274f9a5c0de1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:29.459026 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-748e335b-894b-4612-8abd-274f9a5c0de1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:29.464751 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-748e335b-894b-4612-8abd-274f9a5c0de1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:29.465662 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-748e335b-894b-4612-8abd-274f9a5c0de1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:29.466014 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-748e335b-894b-4612-8abd-274f9a5c0de1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:29.466447 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-748e335b-894b-4612-8abd-274f9a5c0de1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:29.585327 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-748e335b-894b-4612-8abd-274f9a5c0de1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:29.592412 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-748e335b-894b-4612-8abd-274f9a5c0de1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1550 microversion: 2.1 time: 0.137646 Aug 10 05:24:29.593142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 492/987] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:29 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1550 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:31.422600 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4ddb06ad-e1a3-4c9f-88ac-17029ad5a08b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82bc478d-771a-47e7-94ca-a020f4c61951"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:31.423737 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4ddb06ad-e1a3-4c9f-88ac-17029ad5a08b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:31.430120 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ddb06ad-e1a3-4c9f-88ac-17029ad5a08b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:31.430690 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ddb06ad-e1a3-4c9f-88ac-17029ad5a08b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:31.431527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ddb06ad-e1a3-4c9f-88ac-17029ad5a08b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:31.431978 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4ddb06ad-e1a3-4c9f-88ac-17029ad5a08b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:32.211878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4ddb06ad-e1a3-4c9f-88ac-17029ad5a08b tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "POST /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.792523 Aug 10 05:24:32.212485 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 496/988] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:24:31 2021] POST /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments => generated 194 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:40.830221 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-86cf9860-e7d6-4ffd-a9ae-8af1b9c6b95c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:40.830862 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-86cf9860-e7d6-4ffd-a9ae-8af1b9c6b95c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:40.836632 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-86cf9860-e7d6-4ffd-a9ae-8af1b9c6b95c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:40.837079 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-86cf9860-e7d6-4ffd-a9ae-8af1b9c6b95c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:40.838354 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-86cf9860-e7d6-4ffd-a9ae-8af1b9c6b95c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:40.838818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-86cf9860-e7d6-4ffd-a9ae-8af1b9c6b95c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:40.956535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-86cf9860-e7d6-4ffd-a9ae-8af1b9c6b95c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:40.964759 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-86cf9860-e7d6-4ffd-a9ae-8af1b9c6b95c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1596 microversion: 2.1 time: 0.138186 Aug 10 05:24:40.965317 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 493/989] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:40 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1596 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:24:42.924958 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-823fddac-7dcc-4ee0-b15a-4e47a599f988 req-086136ac-f9e2-433d-ae85-f413d03b5a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511b4fd6-05af-42c8-b691-4926486f6f50", "tag": "076ea264-6ca7-4640-a5cc-e7faa9876c93"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:42.926527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:24:42.926527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:24:42.938282 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-823fddac-7dcc-4ee0-b15a-4e47a599f988 req-086136ac-f9e2-433d-ae85-f413d03b5a26 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:42.943778 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-823fddac-7dcc-4ee0-b15a-4e47a599f988 req-086136ac-f9e2-433d-ae85-f413d03b5a26 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:42.949997 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-823fddac-7dcc-4ee0-b15a-4e47a599f988 req-086136ac-f9e2-433d-ae85-f413d03b5a26 service nova] Creating event network-changed:076ea264-6ca7-4640-a5cc-e7faa9876c93 for instance 511b4fd6-05af-42c8-b691-4926486f6f50 on hv-cinder-80390 Aug 10 05:24:42.955026 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-823fddac-7dcc-4ee0-b15a-4e47a599f988 req-086136ac-f9e2-433d-ae85-f413d03b5a26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034591 Aug 10 05:24:42.955450 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 497/990] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:24:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:45.203421 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-800ec604-7fe0-46a6-8795-dfd7dc777642 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1016596095"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:45.204085 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-800ec604-7fe0-46a6-8795-dfd7dc777642 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:45.209771 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-800ec604-7fe0-46a6-8795-dfd7dc777642 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:45.210216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-800ec604-7fe0-46a6-8795-dfd7dc777642 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:45.211020 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-800ec604-7fe0-46a6-8795-dfd7dc777642 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:45.211440 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-800ec604-7fe0-46a6-8795-dfd7dc777642 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:45.325100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.network.security_group_api [None req-800ec604-7fe0-46a6-8795-dfd7dc777642 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Adding security group fadd5a6b-fd27-4f64-af75-7e62b56942a5 to port 076ea264-6ca7-4640-a5cc-e7faa9876c93 Aug 10 05:24:45.685978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-800ec604-7fe0-46a6-8795-dfd7dc777642 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "POST /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/action" status: 202 len: 0 microversion: 2.1 time: 0.486174 Aug 10 05:24:45.686831 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 494/991] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:24:45 2021] POST /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:24:45.695526 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2d42fa0e-c4e1-4cb3-8529-be7849cdf0b3 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:24:45.696200 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2d42fa0e-c4e1-4cb3-8529-be7849cdf0b3 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:24:45.697491 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-8eba3090-1e35-4c79-914d-5a11830e77b8 req-8bd31991-e93a-422b-a63e-a0e4209b1826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511b4fd6-05af-42c8-b691-4926486f6f50", "tag": "076ea264-6ca7-4640-a5cc-e7faa9876c93"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:24:45.700482 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:24:45.700482 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:24:45.705028 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2d42fa0e-c4e1-4cb3-8529-be7849cdf0b3 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:45.705490 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2d42fa0e-c4e1-4cb3-8529-be7849cdf0b3 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:45.706285 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2d42fa0e-c4e1-4cb3-8529-be7849cdf0b3 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:45.706768 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2d42fa0e-c4e1-4cb3-8529-be7849cdf0b3 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:45.708723 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-8eba3090-1e35-4c79-914d-5a11830e77b8 req-8bd31991-e93a-422b-a63e-a0e4209b1826 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:24:45.709165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-8eba3090-1e35-4c79-914d-5a11830e77b8 req-8bd31991-e93a-422b-a63e-a0e4209b1826 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:24:45.738945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-8eba3090-1e35-4c79-914d-5a11830e77b8 req-8bd31991-e93a-422b-a63e-a0e4209b1826 service nova] Creating event network-changed:076ea264-6ca7-4640-a5cc-e7faa9876c93 for instance 511b4fd6-05af-42c8-b691-4926486f6f50 on hv-cinder-80390 Aug 10 05:24:45.748008 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-8eba3090-1e35-4c79-914d-5a11830e77b8 req-8bd31991-e93a-422b-a63e-a0e4209b1826 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056860 Aug 10 05:24:45.758662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 498/992] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:24:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:24:45.953216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-2d42fa0e-c4e1-4cb3-8529-be7849cdf0b3 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:24:45.962260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2d42fa0e-c4e1-4cb3-8529-be7849cdf0b3 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1761 microversion: 2.1 time: 0.270573 Aug 10 05:24:45.963141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 495/993] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:24:45 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1761 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:02.322819 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1250155078", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "05fd25f4-28f9-4b85-a436-be6a306bd0dd"}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:25:02.375284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] validate_networks() for [('05fd25f4-28f9-4b85-a436-be6a306bd0dd', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:25:02.719324 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:25:02.719741 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:25:02.720206 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:25:02.720607 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:25:02.721040 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:25:02.730770 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:02.731216 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:02.732016 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:02.732446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:02.749298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Getting quotas for project b58f808282d0435887cb9b2387e33199. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:25:02.753175 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Getting quotas for user 55db5c11bf8440939f0fc49dd1ec23fc and project b58f808282d0435887cb9b2387e33199. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:25:02.764400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:25:02.766947 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:25:02.885199 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-7c4f6a90-5148-4633-81dd-0a0ddf815d17 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566827 Aug 10 05:25:02.885798 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 499/994] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:25:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:25:02.896507 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-023e0111-e729-4872-aaef-d063f24a3a6d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:02.898168 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-023e0111-e729-4872-aaef-d063f24a3a6d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:02.947803 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-023e0111-e729-4872-aaef-d063f24a3a6d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:02.954847 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-023e0111-e729-4872-aaef-d063f24a3a6d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1219 microversion: 2.1 time: 0.062247 Aug 10 05:25:02.955435 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 496/995] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:02 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:25:03.971477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0b62c3af-4b11-4a11-a381-b521ca499f18 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:03.972040 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0b62c3af-4b11-4a11-a381-b521ca499f18 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:03.978216 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b62c3af-4b11-4a11-a381-b521ca499f18 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:03.978700 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b62c3af-4b11-4a11-a381-b521ca499f18 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:03.979472 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b62c3af-4b11-4a11-a381-b521ca499f18 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:03.979915 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0b62c3af-4b11-4a11-a381-b521ca499f18 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:04.038937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0b62c3af-4b11-4a11-a381-b521ca499f18 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:04.046561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0b62c3af-4b11-4a11-a381-b521ca499f18 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1223 microversion: 2.1 time: 0.078997 Aug 10 05:25:04.050009 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 500/996] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:03 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:05.063867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cadb5a53-7729-40d9-a616-5b1712648d85 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:05.064493 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cadb5a53-7729-40d9-a616-5b1712648d85 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:05.070202 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cadb5a53-7729-40d9-a616-5b1712648d85 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:05.070683 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cadb5a53-7729-40d9-a616-5b1712648d85 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:05.071456 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cadb5a53-7729-40d9-a616-5b1712648d85 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:05.071890 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cadb5a53-7729-40d9-a616-5b1712648d85 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:05.137750 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cadb5a53-7729-40d9-a616-5b1712648d85 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:05.145142 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cadb5a53-7729-40d9-a616-5b1712648d85 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1289 microversion: 2.1 time: 0.085090 Aug 10 05:25:05.145715 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 497/997] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:05 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:06.160933 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c87f66f2-3f54-4a04-8c17-a00a454cf6af tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:06.161554 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c87f66f2-3f54-4a04-8c17-a00a454cf6af tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:06.167278 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c87f66f2-3f54-4a04-8c17-a00a454cf6af tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:06.169711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c87f66f2-3f54-4a04-8c17-a00a454cf6af tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:06.169711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c87f66f2-3f54-4a04-8c17-a00a454cf6af tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:06.169711 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c87f66f2-3f54-4a04-8c17-a00a454cf6af tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:06.291692 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c87f66f2-3f54-4a04-8c17-a00a454cf6af tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:06.299024 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c87f66f2-3f54-4a04-8c17-a00a454cf6af tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1319 microversion: 2.1 time: 0.141702 Aug 10 05:25:06.299597 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 501/998] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:06 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:06.501123 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-7eb04ed9-475c-4bcf-832c-896d7286d54b req-c045debd-c9ac-46e7-a5b4-3bdfde89580c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc22733d-1c02-46d9-b263-ec0dfb2aac53", "tag": "243083f4-0248-4f3d-8361-8e8cfae50304"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:25:06.502775 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:25:06.502775 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:25:06.509581 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-7eb04ed9-475c-4bcf-832c-896d7286d54b req-c045debd-c9ac-46e7-a5b4-3bdfde89580c service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:06.510037 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-7eb04ed9-475c-4bcf-832c-896d7286d54b req-c045debd-c9ac-46e7-a5b4-3bdfde89580c service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:06.525411 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-7eb04ed9-475c-4bcf-832c-896d7286d54b req-c045debd-c9ac-46e7-a5b4-3bdfde89580c service nova] Creating event network-changed:243083f4-0248-4f3d-8361-8e8cfae50304 for instance cc22733d-1c02-46d9-b263-ec0dfb2aac53 on hv-cinder-80390 Aug 10 05:25:06.530275 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-7eb04ed9-475c-4bcf-832c-896d7286d54b req-c045debd-c9ac-46e7-a5b4-3bdfde89580c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033927 Aug 10 05:25:06.530923 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 498/999] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:25:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:25:07.315207 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-8ee9fee0-aa1a-4e58-b39e-4d17379177b8 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:07.315813 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-8ee9fee0-aa1a-4e58-b39e-4d17379177b8 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:07.321596 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8ee9fee0-aa1a-4e58-b39e-4d17379177b8 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:07.324226 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8ee9fee0-aa1a-4e58-b39e-4d17379177b8 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:07.324226 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8ee9fee0-aa1a-4e58-b39e-4d17379177b8 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:07.324226 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-8ee9fee0-aa1a-4e58-b39e-4d17379177b8 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:07.439436 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-8ee9fee0-aa1a-4e58-b39e-4d17379177b8 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:07.446544 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-8ee9fee0-aa1a-4e58-b39e-4d17379177b8 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1319 microversion: 2.1 time: 0.135177 Aug 10 05:25:07.447127 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 502/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:07 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1319 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:08.340722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3eb34c6d-7c9d-4cef-a1a2-03d4ee47d004 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:25:08.341763 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3eb34c6d-7c9d-4cef-a1a2-03d4ee47d004 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:08.347834 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3eb34c6d-7c9d-4cef-a1a2-03d4ee47d004 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:08.348281 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3eb34c6d-7c9d-4cef-a1a2-03d4ee47d004 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:08.349038 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3eb34c6d-7c9d-4cef-a1a2-03d4ee47d004 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:08.349468 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3eb34c6d-7c9d-4cef-a1a2-03d4ee47d004 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:08.463200 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e52490f5-ddac-43e3-bff8-3953ddfb1ace tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:08.463748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e52490f5-ddac-43e3-bff8-3953ddfb1ace tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:08.469617 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e52490f5-ddac-43e3-bff8-3953ddfb1ace tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:08.470070 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e52490f5-ddac-43e3-bff8-3953ddfb1ace tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:08.470884 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e52490f5-ddac-43e3-bff8-3953ddfb1ace tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:08.471339 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e52490f5-ddac-43e3-bff8-3953ddfb1ace tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:08.530033 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3eb34c6d-7c9d-4cef-a1a2-03d4ee47d004 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "POST /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/action" status: 202 len: 0 microversion: 2.1 time: 0.193065 Aug 10 05:25:08.533824 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 499/1001] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:25:08 2021] POST /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:25:08.539393 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-3d5dc591-601a-4821-ad6e-3d802fb41ae2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:08.540124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-3d5dc591-601a-4821-ad6e-3d802fb41ae2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:08.547060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3d5dc591-601a-4821-ad6e-3d802fb41ae2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:08.547512 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3d5dc591-601a-4821-ad6e-3d802fb41ae2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:08.548302 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3d5dc591-601a-4821-ad6e-3d802fb41ae2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:08.548741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-3d5dc591-601a-4821-ad6e-3d802fb41ae2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:08.597257 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-e52490f5-ddac-43e3-bff8-3953ddfb1ace tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:08.604458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e52490f5-ddac-43e3-bff8-3953ddfb1ace tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1319 microversion: 2.1 time: 0.145080 Aug 10 05:25:08.605006 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 503/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:08 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:25:08.682535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-3d5dc591-601a-4821-ad6e-3d802fb41ae2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:08.690265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-3d5dc591-601a-4821-ad6e-3d802fb41ae2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1753 microversion: 2.1 time: 0.154864 Aug 10 05:25:08.690866 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 500/1003] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:08 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:09.621024 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-97588cd4-7ead-4b63-8d6c-d6e89199f4b3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:09.621632 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-97588cd4-7ead-4b63-8d6c-d6e89199f4b3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:09.627930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97588cd4-7ead-4b63-8d6c-d6e89199f4b3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:09.628379 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97588cd4-7ead-4b63-8d6c-d6e89199f4b3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:09.629147 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97588cd4-7ead-4b63-8d6c-d6e89199f4b3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:09.629613 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97588cd4-7ead-4b63-8d6c-d6e89199f4b3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:09.707113 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8efe8f79-57b2-4df1-956f-f6c754513fd8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:09.707980 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8efe8f79-57b2-4df1-956f-f6c754513fd8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:09.713964 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8efe8f79-57b2-4df1-956f-f6c754513fd8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:09.714508 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8efe8f79-57b2-4df1-956f-f6c754513fd8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:09.715392 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8efe8f79-57b2-4df1-956f-f6c754513fd8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:09.715907 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8efe8f79-57b2-4df1-956f-f6c754513fd8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:09.757912 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-97588cd4-7ead-4b63-8d6c-d6e89199f4b3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:09.765309 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-97588cd4-7ead-4b63-8d6c-d6e89199f4b3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1319 microversion: 2.1 time: 0.147881 Aug 10 05:25:09.766352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 504/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:09 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:09.842886 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8efe8f79-57b2-4df1-956f-f6c754513fd8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:09.850692 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8efe8f79-57b2-4df1-956f-f6c754513fd8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.147219 Aug 10 05:25:09.851263 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 501/1005] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:09 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:25:10.781660 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-72a8f8e3-fae7-42d9-ad07-d9766ee2c4a7 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:10.782195 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-72a8f8e3-fae7-42d9-ad07-d9766ee2c4a7 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:10.788446 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-72a8f8e3-fae7-42d9-ad07-d9766ee2c4a7 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:10.788896 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-72a8f8e3-fae7-42d9-ad07-d9766ee2c4a7 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:10.789656 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-72a8f8e3-fae7-42d9-ad07-d9766ee2c4a7 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:10.790091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-72a8f8e3-fae7-42d9-ad07-d9766ee2c4a7 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:10.868463 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-130c5907-acbf-4034-932c-c1cb44ebf17a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:10.869076 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-130c5907-acbf-4034-932c-c1cb44ebf17a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:10.875223 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-130c5907-acbf-4034-932c-c1cb44ebf17a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:10.875676 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-130c5907-acbf-4034-932c-c1cb44ebf17a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:10.876444 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-130c5907-acbf-4034-932c-c1cb44ebf17a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:10.876880 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-130c5907-acbf-4034-932c-c1cb44ebf17a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:10.905835 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-72a8f8e3-fae7-42d9-ad07-d9766ee2c4a7 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:10.913150 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-72a8f8e3-fae7-42d9-ad07-d9766ee2c4a7 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1319 microversion: 2.1 time: 0.135244 Aug 10 05:25:10.913857 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 505/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:10 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1319 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:10.997598 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-130c5907-acbf-4034-932c-c1cb44ebf17a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:11.005225 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-130c5907-acbf-4034-932c-c1cb44ebf17a tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.140520 Aug 10 05:25:11.005787 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 502/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:10 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:25:11.535627 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-b091f9a1-ad46-4225-8f1e-0fc8e6c8d44e req-cb78b7b3-e82d-4c0e-b4b5-7f239af939ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc22733d-1c02-46d9-b263-ec0dfb2aac53", "name": "network-vif-plugged", "status": "completed", "tag": "243083f4-0248-4f3d-8361-8e8cfae50304"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:25:11.539504 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:25:11.539504 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:25:11.544010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-b091f9a1-ad46-4225-8f1e-0fc8e6c8d44e req-cb78b7b3-e82d-4c0e-b4b5-7f239af939ca service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:11.544454 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-b091f9a1-ad46-4225-8f1e-0fc8e6c8d44e req-cb78b7b3-e82d-4c0e-b4b5-7f239af939ca service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:11.555096 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-b091f9a1-ad46-4225-8f1e-0fc8e6c8d44e req-cb78b7b3-e82d-4c0e-b4b5-7f239af939ca service nova] Creating event network-vif-plugged:243083f4-0248-4f3d-8361-8e8cfae50304 for instance cc22733d-1c02-46d9-b263-ec0dfb2aac53 on hv-cinder-80390 Aug 10 05:25:11.560649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-b091f9a1-ad46-4225-8f1e-0fc8e6c8d44e req-cb78b7b3-e82d-4c0e-b4b5-7f239af939ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028564 Aug 10 05:25:11.561227 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 506/1008] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:25:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:25:11.930251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a442caea-689c-4ddf-a432-dc18c1395520 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:11.930888 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a442caea-689c-4ddf-a432-dc18c1395520 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:11.937277 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a442caea-689c-4ddf-a432-dc18c1395520 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:11.937724 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a442caea-689c-4ddf-a432-dc18c1395520 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:11.938487 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a442caea-689c-4ddf-a432-dc18c1395520 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:11.938947 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a442caea-689c-4ddf-a432-dc18c1395520 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:12.021364 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bfe1503d-802e-4f75-becd-ab88c662ab5d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:12.022064 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-bfe1503d-802e-4f75-becd-ab88c662ab5d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:12.028086 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bfe1503d-802e-4f75-becd-ab88c662ab5d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:12.028537 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bfe1503d-802e-4f75-becd-ab88c662ab5d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:12.029305 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bfe1503d-802e-4f75-becd-ab88c662ab5d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:12.029747 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bfe1503d-802e-4f75-becd-ab88c662ab5d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:12.055104 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a442caea-689c-4ddf-a432-dc18c1395520 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:12.062914 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a442caea-689c-4ddf-a432-dc18c1395520 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1319 microversion: 2.1 time: 0.136212 Aug 10 05:25:12.063479 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 503/1009] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:11 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1319 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:12.153992 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-bfe1503d-802e-4f75-becd-ab88c662ab5d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:12.161733 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bfe1503d-802e-4f75-becd-ab88c662ab5d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.144329 Aug 10 05:25:12.162298 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 507/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:12 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:25:13.079511 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-42de0348-814d-4662-a72d-3d221ae2f2aa tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:13.080131 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-42de0348-814d-4662-a72d-3d221ae2f2aa tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:13.085947 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-42de0348-814d-4662-a72d-3d221ae2f2aa tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:13.086411 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-42de0348-814d-4662-a72d-3d221ae2f2aa tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:13.087342 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-42de0348-814d-4662-a72d-3d221ae2f2aa tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:13.087792 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-42de0348-814d-4662-a72d-3d221ae2f2aa tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:13.178944 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c36a70b8-91c3-4278-8895-91d8070a4ab5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:13.179955 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c36a70b8-91c3-4278-8895-91d8070a4ab5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:13.186225 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c36a70b8-91c3-4278-8895-91d8070a4ab5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:13.186736 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c36a70b8-91c3-4278-8895-91d8070a4ab5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:13.187584 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c36a70b8-91c3-4278-8895-91d8070a4ab5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:13.188024 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c36a70b8-91c3-4278-8895-91d8070a4ab5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:13.207550 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-42de0348-814d-4662-a72d-3d221ae2f2aa tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:13.214717 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-42de0348-814d-4662-a72d-3d221ae2f2aa tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1508 microversion: 2.1 time: 0.139498 Aug 10 05:25:13.215517 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 504/1011] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:13 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:13.312138 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c36a70b8-91c3-4278-8895-91d8070a4ab5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:13.319789 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c36a70b8-91c3-4278-8895-91d8070a4ab5 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.144438 Aug 10 05:25:13.322250 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 508/1012] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:13 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:25:14.337120 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a12e7596-8f92-43b8-9a11-75d9f90eadb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:14.337734 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a12e7596-8f92-43b8-9a11-75d9f90eadb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:14.344346 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a12e7596-8f92-43b8-9a11-75d9f90eadb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:14.344803 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a12e7596-8f92-43b8-9a11-75d9f90eadb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:14.345607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a12e7596-8f92-43b8-9a11-75d9f90eadb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:14.346052 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a12e7596-8f92-43b8-9a11-75d9f90eadb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:14.468575 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a12e7596-8f92-43b8-9a11-75d9f90eadb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:14.476512 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a12e7596-8f92-43b8-9a11-75d9f90eadb4 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.143064 Aug 10 05:25:14.477065 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 505/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:14 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:15.493442 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c4306339-5e2d-4d96-8ba1-78fb3636e661 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:15.494067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c4306339-5e2d-4d96-8ba1-78fb3636e661 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:15.500639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c4306339-5e2d-4d96-8ba1-78fb3636e661 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:15.501088 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c4306339-5e2d-4d96-8ba1-78fb3636e661 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:15.501860 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c4306339-5e2d-4d96-8ba1-78fb3636e661 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:15.502293 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c4306339-5e2d-4d96-8ba1-78fb3636e661 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:15.622007 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c4306339-5e2d-4d96-8ba1-78fb3636e661 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:15.630954 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c4306339-5e2d-4d96-8ba1-78fb3636e661 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.141537 Aug 10 05:25:15.631769 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 509/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:15 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:16.649061 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-b180dbe7-07e3-483a-a1d7-c0ec8afd3629 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:16.649668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-b180dbe7-07e3-483a-a1d7-c0ec8afd3629 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:16.655623 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b180dbe7-07e3-483a-a1d7-c0ec8afd3629 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:16.656114 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b180dbe7-07e3-483a-a1d7-c0ec8afd3629 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:16.657452 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b180dbe7-07e3-483a-a1d7-c0ec8afd3629 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:16.657888 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-b180dbe7-07e3-483a-a1d7-c0ec8afd3629 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:16.780888 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-b180dbe7-07e3-483a-a1d7-c0ec8afd3629 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:16.788631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-b180dbe7-07e3-483a-a1d7-c0ec8afd3629 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.143318 Aug 10 05:25:16.789194 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 506/1015] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:16 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:25:17.805324 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-a97c03d2-c855-4a75-abd0-a2a6db5d5dfc tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:17.805874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-a97c03d2-c855-4a75-abd0-a2a6db5d5dfc tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:17.811789 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a97c03d2-c855-4a75-abd0-a2a6db5d5dfc tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:17.812238 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a97c03d2-c855-4a75-abd0-a2a6db5d5dfc tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:17.813043 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a97c03d2-c855-4a75-abd0-a2a6db5d5dfc tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:17.813473 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-a97c03d2-c855-4a75-abd0-a2a6db5d5dfc tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:17.937374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-a97c03d2-c855-4a75-abd0-a2a6db5d5dfc tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:17.945311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-a97c03d2-c855-4a75-abd0-a2a6db5d5dfc tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.143796 Aug 10 05:25:17.946115 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 510/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:17 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:18.962935 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-325ec869-e0ad-4c14-8332-231df56d9b36 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:18.963632 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-325ec869-e0ad-4c14-8332-231df56d9b36 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:18.970013 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-325ec869-e0ad-4c14-8332-231df56d9b36 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:18.970456 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-325ec869-e0ad-4c14-8332-231df56d9b36 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:18.971259 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-325ec869-e0ad-4c14-8332-231df56d9b36 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:18.971693 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-325ec869-e0ad-4c14-8332-231df56d9b36 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:19.096264 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-325ec869-e0ad-4c14-8332-231df56d9b36 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:19.104385 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-325ec869-e0ad-4c14-8332-231df56d9b36 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.145104 Aug 10 05:25:19.104979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 507/1017] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:18 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:20.121393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-4c7f1b1d-1175-48b3-87a9-6cfaf86b49e0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:20.122004 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-4c7f1b1d-1175-48b3-87a9-6cfaf86b49e0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:20.128461 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c7f1b1d-1175-48b3-87a9-6cfaf86b49e0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:20.128925 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c7f1b1d-1175-48b3-87a9-6cfaf86b49e0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:20.129717 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c7f1b1d-1175-48b3-87a9-6cfaf86b49e0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:20.130158 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-4c7f1b1d-1175-48b3-87a9-6cfaf86b49e0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:20.264276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-4c7f1b1d-1175-48b3-87a9-6cfaf86b49e0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:20.272771 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-4c7f1b1d-1175-48b3-87a9-6cfaf86b49e0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1758 microversion: 2.1 time: 0.155146 Aug 10 05:25:20.273352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 511/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:20 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1758 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:21.291463 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1526910d-1157-4ef3-a795-00bc8558f7fb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:21.292067 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1526910d-1157-4ef3-a795-00bc8558f7fb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:21.298023 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1526910d-1157-4ef3-a795-00bc8558f7fb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:21.298470 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1526910d-1157-4ef3-a795-00bc8558f7fb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:21.299261 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1526910d-1157-4ef3-a795-00bc8558f7fb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:21.299702 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1526910d-1157-4ef3-a795-00bc8558f7fb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:21.429939 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-1526910d-1157-4ef3-a795-00bc8558f7fb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:21.438332 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1526910d-1157-4ef3-a795-00bc8558f7fb tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1761 microversion: 2.1 time: 0.150214 Aug 10 05:25:21.438925 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 508/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:21 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1761 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:29.653232 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-47c46c9a-65b5-47cc-982d-46e97b1d0a4d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8040898-7dfb-46e0-9ff4-274a6d9614c3", "device": "/dev/sdb"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:25:29.654827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-47c46c9a-65b5-47cc-982d-46e97b1d0a4d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:29.661102 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-47c46c9a-65b5-47cc-982d-46e97b1d0a4d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:29.661555 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-47c46c9a-65b5-47cc-982d-46e97b1d0a4d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:29.662318 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-47c46c9a-65b5-47cc-982d-46e97b1d0a4d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:29.662778 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-47c46c9a-65b5-47cc-982d-46e97b1d0a4d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:30.363933 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-47c46c9a-65b5-47cc-982d-46e97b1d0a4d tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "POST /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.714164 Aug 10 05:25:30.364538 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 512/1020] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:25:29 2021] POST /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53/os-volume_attachments => generated 194 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:25:33.016349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:25:33.044518 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:25:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:25:54.695169 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e3b5e2fc-34fa-46fb-8e2c-a926693cc7a3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:54.695773 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e3b5e2fc-34fa-46fb-8e2c-a926693cc7a3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:54.702211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e3b5e2fc-34fa-46fb-8e2c-a926693cc7a3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:54.702772 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e3b5e2fc-34fa-46fb-8e2c-a926693cc7a3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:54.703559 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e3b5e2fc-34fa-46fb-8e2c-a926693cc7a3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:54.704002 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e3b5e2fc-34fa-46fb-8e2c-a926693cc7a3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:54.901131 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-e3b5e2fc-34fa-46fb-8e2c-a926693cc7a3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lazy-loading 'services' on Instance uuid cc22733d-1c02-46d9-b263-ec0dfb2aac53 {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:25:55.114293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e3b5e2fc-34fa-46fb-8e2c-a926693cc7a3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53/os-volume_attachments/b8040898-7dfb-46e0-9ff4-274a6d9614c3" status: 202 len: 0 microversion: 2.1 time: 0.422636 Aug 10 05:25:55.115203 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 509/1021] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:25:54 2021] DELETE /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53/os-volume_attachments/b8040898-7dfb-46e0-9ff4-274a6d9614c3 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:25:56.231795 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0c78277b-cbee-4452-8ae9-4e6208a5595c tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:56.232374 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0c78277b-cbee-4452-8ae9-4e6208a5595c tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:56.239901 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c78277b-cbee-4452-8ae9-4e6208a5595c tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:56.244381 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c78277b-cbee-4452-8ae9-4e6208a5595c tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:56.244381 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c78277b-cbee-4452-8ae9-4e6208a5595c tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:56.244381 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c78277b-cbee-4452-8ae9-4e6208a5595c tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:56.265564 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0c78277b-cbee-4452-8ae9-4e6208a5595c tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:25:56.531284 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0c78277b-cbee-4452-8ae9-4e6208a5595c tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 204 len: 0 microversion: 2.1 time: 0.303668 Aug 10 05:25:56.532102 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 513/1022] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:25:56 2021] DELETE /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:25:56.540523 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4fafa944-6f5d-4eb0-b9f3-c122f47366ac tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:56.544272 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4fafa944-6f5d-4eb0-b9f3-c122f47366ac tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:56.548705 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4fafa944-6f5d-4eb0-b9f3-c122f47366ac tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:56.549148 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4fafa944-6f5d-4eb0-b9f3-c122f47366ac tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:56.549912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4fafa944-6f5d-4eb0-b9f3-c122f47366ac tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:56.550341 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4fafa944-6f5d-4eb0-b9f3-c122f47366ac tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:56.669893 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4fafa944-6f5d-4eb0-b9f3-c122f47366ac tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:56.677193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4fafa944-6f5d-4eb0-b9f3-c122f47366ac tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1514 microversion: 2.1 time: 0.140844 Aug 10 05:25:56.677751 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 510/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:56 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:25:57.693943 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-92b025da-0896-4847-a426-25014b00a33b tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:57.694706 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-92b025da-0896-4847-a426-25014b00a33b tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:57.701293 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92b025da-0896-4847-a426-25014b00a33b tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:57.701765 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92b025da-0896-4847-a426-25014b00a33b tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:57.702518 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92b025da-0896-4847-a426-25014b00a33b tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:57.702981 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-92b025da-0896-4847-a426-25014b00a33b tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:57.883520 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-92b025da-0896-4847-a426-25014b00a33b tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:57.891400 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-92b025da-0896-4847-a426-25014b00a33b tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1514 microversion: 2.1 time: 0.201451 Aug 10 05:25:57.891965 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 514/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:57 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:25:58.834980 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-6dd5d1c7-eb79-4f7c-b34d-cf811eb8e447 req-f17e9289-64e6-4917-9df5-09baaccc57a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc22733d-1c02-46d9-b263-ec0dfb2aac53", "name": "network-vif-deleted", "tag": "243083f4-0248-4f3d-8361-8e8cfae50304"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:25:58.836519 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:25:58.836519 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:25:58.843782 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-6dd5d1c7-eb79-4f7c-b34d-cf811eb8e447 req-f17e9289-64e6-4917-9df5-09baaccc57a8 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:58.847312 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-6dd5d1c7-eb79-4f7c-b34d-cf811eb8e447 req-f17e9289-64e6-4917-9df5-09baaccc57a8 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:58.855225 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-6dd5d1c7-eb79-4f7c-b34d-cf811eb8e447 req-f17e9289-64e6-4917-9df5-09baaccc57a8 service nova] Creating event network-vif-deleted:243083f4-0248-4f3d-8361-8e8cfae50304 for instance cc22733d-1c02-46d9-b263-ec0dfb2aac53 on hv-cinder-80390 Aug 10 05:25:58.860105 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-6dd5d1c7-eb79-4f7c-b34d-cf811eb8e447 req-f17e9289-64e6-4917-9df5-09baaccc57a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028453 Aug 10 05:25:58.860681 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 511/1025] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:25:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:25:58.908131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-bc342e3c-0fef-4355-a568-a36e94ce1368 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:25:58.908771 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-bc342e3c-0fef-4355-a568-a36e94ce1368 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:25:58.914984 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bc342e3c-0fef-4355-a568-a36e94ce1368 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:58.915429 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bc342e3c-0fef-4355-a568-a36e94ce1368 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:58.916184 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bc342e3c-0fef-4355-a568-a36e94ce1368 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:25:58.916707 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-bc342e3c-0fef-4355-a568-a36e94ce1368 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:25:58.978878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-bc342e3c-0fef-4355-a568-a36e94ce1368 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:25:58.986477 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-bc342e3c-0fef-4355-a568-a36e94ce1368 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 200 len: 1472 microversion: 2.1 time: 0.081914 Aug 10 05:25:58.987068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 515/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:58 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:00.002644 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:00.003348 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: cc22733d-1c02-46d9-b263-ec0dfb2aac53] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:00.009339 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:00.009788 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:00.010554 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:00.011020 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:00.023722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] HTTP exception thrown: Instance cc22733d-1c02-46d9-b263-ec0dfb2aac53 could not be found. Aug 10 05:26:00.024298 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Returning 404 to user: Instance cc22733d-1c02-46d9-b263-ec0dfb2aac53 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:26:00.025152 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-caec0e08-dea0-4535-b73b-daab206d1624 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53" status: 404 len: 111 microversion: 2.1 time: 0.026547 Aug 10 05:26:00.025666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 512/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:25:59 2021] GET /compute/v2.1/servers/cc22733d-1c02-46d9-b263-ec0dfb2aac53 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:26:10.268069 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-513494495", "imageRef": "041cc5a2-d79b-4ff8-947a-439c71a6d234", "flavorRef": "452", "networks": [{"uuid": "05fd25f4-28f9-4b85-a436-be6a306bd0dd"}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:10.318373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] validate_networks() for [('05fd25f4-28f9-4b85-a436-be6a306bd0dd', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:26:10.658027 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:26:10.658444 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:26:10.658954 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:26:10.659388 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:26:10.659798 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:26:10.668372 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:10.669851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:10.669851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:10.670120 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:10.686112 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Getting quotas for project b58f808282d0435887cb9b2387e33199. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:26:10.690030 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Getting quotas for user 55db5c11bf8440939f0fc49dd1ec23fc and project b58f808282d0435887cb9b2387e33199. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:26:10.701011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:26:10.703358 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='041cc5a2-d79b-4ff8-947a-439c71a6d234',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:26:10.816630 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c5d3857f-cb74-4ce0-af99-40032af7880a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552124 Aug 10 05:26:10.817263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 516/1028] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:26:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:26:10.827694 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a2902c5f-7382-4b37-9297-426d7fd9eb84 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:10.828322 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a2902c5f-7382-4b37-9297-426d7fd9eb84 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:10.878333 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a2902c5f-7382-4b37-9297-426d7fd9eb84 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:10.884765 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a2902c5f-7382-4b37-9297-426d7fd9eb84 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1218 microversion: 2.1 time: 0.061449 Aug 10 05:26:10.885321 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 513/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:10 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1218 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:11.901463 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3f388be0-b1d9-4fc2-9774-b70edbc29c6a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:11.902070 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3f388be0-b1d9-4fc2-9774-b70edbc29c6a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:11.908501 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3f388be0-b1d9-4fc2-9774-b70edbc29c6a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:11.909103 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3f388be0-b1d9-4fc2-9774-b70edbc29c6a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:11.909865 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3f388be0-b1d9-4fc2-9774-b70edbc29c6a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:11.910424 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-3f388be0-b1d9-4fc2-9774-b70edbc29c6a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:11.974674 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3f388be0-b1d9-4fc2-9774-b70edbc29c6a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:11.981836 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3f388be0-b1d9-4fc2-9774-b70edbc29c6a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1214 microversion: 2.1 time: 0.084148 Aug 10 05:26:11.982394 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 517/1030] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:11 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:12.998971 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-94e94d20-39f4-4926-9dd6-7865e9887331 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:12.999605 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-94e94d20-39f4-4926-9dd6-7865e9887331 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:13.005392 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-94e94d20-39f4-4926-9dd6-7865e9887331 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:13.005843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-94e94d20-39f4-4926-9dd6-7865e9887331 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:13.006625 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-94e94d20-39f4-4926-9dd6-7865e9887331 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:13.007062 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-94e94d20-39f4-4926-9dd6-7865e9887331 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:13.072438 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-94e94d20-39f4-4926-9dd6-7865e9887331 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:13.080088 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-94e94d20-39f4-4926-9dd6-7865e9887331 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1276 microversion: 2.1 time: 0.084908 Aug 10 05:26:13.080654 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 514/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:12 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:14.097712 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-72f9dc84-a326-47e4-8599-63eba1fc9ff9 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:14.099009 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-72f9dc84-a326-47e4-8599-63eba1fc9ff9 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:14.104979 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-72f9dc84-a326-47e4-8599-63eba1fc9ff9 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:14.105650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-72f9dc84-a326-47e4-8599-63eba1fc9ff9 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:14.107005 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-72f9dc84-a326-47e4-8599-63eba1fc9ff9 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:14.107448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-72f9dc84-a326-47e4-8599-63eba1fc9ff9 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:14.225285 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-72f9dc84-a326-47e4-8599-63eba1fc9ff9 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:14.232534 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-72f9dc84-a326-47e4-8599-63eba1fc9ff9 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1318 microversion: 2.1 time: 0.138733 Aug 10 05:26:14.233111 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 518/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:14 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:14.354205 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-2de3e5b4-5c14-41f7-a4c5-504f21cc78d3 req-2f21953f-23c8-414b-a97b-a8b79b3dd965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9839787-25a1-4a03-b3db-d8633dd295f5", "tag": "a1a18f56-2e81-4442-91f2-51b8d12fc27a"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:14.355849 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:26:14.355849 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:26:14.362943 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-2de3e5b4-5c14-41f7-a4c5-504f21cc78d3 req-2f21953f-23c8-414b-a97b-a8b79b3dd965 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:14.367817 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-2de3e5b4-5c14-41f7-a4c5-504f21cc78d3 req-2f21953f-23c8-414b-a97b-a8b79b3dd965 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:14.374237 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-2de3e5b4-5c14-41f7-a4c5-504f21cc78d3 req-2f21953f-23c8-414b-a97b-a8b79b3dd965 service nova] Creating event network-changed:a1a18f56-2e81-4442-91f2-51b8d12fc27a for instance c9839787-25a1-4a03-b3db-d8633dd295f5 on hv-cinder-80390 Aug 10 05:26:14.378873 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-2de3e5b4-5c14-41f7-a4c5-504f21cc78d3 req-2f21953f-23c8-414b-a97b-a8b79b3dd965 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028284 Aug 10 05:26:14.379455 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 515/1033] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:26:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:26:15.250608 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-756d54ed-989c-4e32-9c05-e0a531de9de3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:15.251230 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-756d54ed-989c-4e32-9c05-e0a531de9de3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:15.257197 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-756d54ed-989c-4e32-9c05-e0a531de9de3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:15.257627 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-756d54ed-989c-4e32-9c05-e0a531de9de3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:15.258386 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-756d54ed-989c-4e32-9c05-e0a531de9de3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:15.258842 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-756d54ed-989c-4e32-9c05-e0a531de9de3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:15.375288 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-756d54ed-989c-4e32-9c05-e0a531de9de3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:15.382346 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-756d54ed-989c-4e32-9c05-e0a531de9de3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1318 microversion: 2.1 time: 0.136952 Aug 10 05:26:15.382938 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 519/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:15 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:16.399375 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-265d0cf9-9ef3-47e1-8761-87b146450759 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:16.399985 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-265d0cf9-9ef3-47e1-8761-87b146450759 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:16.405948 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-265d0cf9-9ef3-47e1-8761-87b146450759 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:16.406394 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-265d0cf9-9ef3-47e1-8761-87b146450759 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:16.407181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-265d0cf9-9ef3-47e1-8761-87b146450759 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:16.407620 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-265d0cf9-9ef3-47e1-8761-87b146450759 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:16.525050 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-265d0cf9-9ef3-47e1-8761-87b146450759 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:16.532345 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-265d0cf9-9ef3-47e1-8761-87b146450759 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1318 microversion: 2.1 time: 0.137046 Aug 10 05:26:16.532902 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 516/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:16 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:17.547982 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-eac4ae3c-0841-4ccd-8598-1274f0ee25d3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:17.548591 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-eac4ae3c-0841-4ccd-8598-1274f0ee25d3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:17.554408 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eac4ae3c-0841-4ccd-8598-1274f0ee25d3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:17.554881 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eac4ae3c-0841-4ccd-8598-1274f0ee25d3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:17.555639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eac4ae3c-0841-4ccd-8598-1274f0ee25d3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:17.556068 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eac4ae3c-0841-4ccd-8598-1274f0ee25d3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:17.674789 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-eac4ae3c-0841-4ccd-8598-1274f0ee25d3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:17.682059 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-eac4ae3c-0841-4ccd-8598-1274f0ee25d3 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1318 microversion: 2.1 time: 0.137714 Aug 10 05:26:17.682642 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 520/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:17 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:26:18.699049 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ebb8e1d3-945f-4e4a-bc23-d0579744d587 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:18.700202 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ebb8e1d3-945f-4e4a-bc23-d0579744d587 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:18.706072 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ebb8e1d3-945f-4e4a-bc23-d0579744d587 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:18.706519 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ebb8e1d3-945f-4e4a-bc23-d0579744d587 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:18.707310 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ebb8e1d3-945f-4e4a-bc23-d0579744d587 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:18.707746 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ebb8e1d3-945f-4e4a-bc23-d0579744d587 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:18.823200 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ebb8e1d3-945f-4e4a-bc23-d0579744d587 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:18.830846 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ebb8e1d3-945f-4e4a-bc23-d0579744d587 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1318 microversion: 2.1 time: 0.135417 Aug 10 05:26:18.831415 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 517/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:18 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:19.853176 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-90194e73-29ea-41eb-b301-68c5f27e381a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:19.853949 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-90194e73-29ea-41eb-b301-68c5f27e381a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:19.860781 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-90194e73-29ea-41eb-b301-68c5f27e381a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:19.861242 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-90194e73-29ea-41eb-b301-68c5f27e381a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:19.862011 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-90194e73-29ea-41eb-b301-68c5f27e381a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:19.862448 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-90194e73-29ea-41eb-b301-68c5f27e381a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:19.894899 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-090d11ee-bd0b-42db-962f-b2d43fac9174 req-76c9b567-3947-45c0-aaf6-546b0cb5c05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9839787-25a1-4a03-b3db-d8633dd295f5", "name": "network-vif-plugged", "status": "completed", "tag": "a1a18f56-2e81-4442-91f2-51b8d12fc27a"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:19.896558 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:26:19.896558 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:26:19.905498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-090d11ee-bd0b-42db-962f-b2d43fac9174 req-76c9b567-3947-45c0-aaf6-546b0cb5c05b service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:19.906650 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-090d11ee-bd0b-42db-962f-b2d43fac9174 req-76c9b567-3947-45c0-aaf6-546b0cb5c05b service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:19.918024 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-090d11ee-bd0b-42db-962f-b2d43fac9174 req-76c9b567-3947-45c0-aaf6-546b0cb5c05b service nova] Creating event network-vif-plugged:a1a18f56-2e81-4442-91f2-51b8d12fc27a for instance c9839787-25a1-4a03-b3db-d8633dd295f5 on hv-cinder-80390 Aug 10 05:26:19.923668 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-090d11ee-bd0b-42db-962f-b2d43fac9174 req-76c9b567-3947-45c0-aaf6-546b0cb5c05b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093330 Aug 10 05:26:19.924263 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 521/1038] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:26:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:19.987227 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-90194e73-29ea-41eb-b301-68c5f27e381a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:19.994491 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-90194e73-29ea-41eb-b301-68c5f27e381a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1318 microversion: 2.1 time: 0.145122 Aug 10 05:26:19.995085 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 518/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:19 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:21.011729 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5ed02377-32ea-4206-8556-a55a8dcfc783 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:21.012414 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5ed02377-32ea-4206-8556-a55a8dcfc783 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:21.019010 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ed02377-32ea-4206-8556-a55a8dcfc783 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:21.019457 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ed02377-32ea-4206-8556-a55a8dcfc783 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:21.020213 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ed02377-32ea-4206-8556-a55a8dcfc783 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:21.020641 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5ed02377-32ea-4206-8556-a55a8dcfc783 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:21.140173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5ed02377-32ea-4206-8556-a55a8dcfc783 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:21.147312 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5ed02377-32ea-4206-8556-a55a8dcfc783 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1318 microversion: 2.1 time: 0.139553 Aug 10 05:26:21.147875 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 522/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:21 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:22.164060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ccd24556-c531-49c2-a364-99ab26573a69 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:22.164677 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ccd24556-c531-49c2-a364-99ab26573a69 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:22.171531 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ccd24556-c531-49c2-a364-99ab26573a69 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:22.171990 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ccd24556-c531-49c2-a364-99ab26573a69 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:22.172766 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ccd24556-c531-49c2-a364-99ab26573a69 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:22.173210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ccd24556-c531-49c2-a364-99ab26573a69 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:22.292165 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ccd24556-c531-49c2-a364-99ab26573a69 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:22.300089 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ccd24556-c531-49c2-a364-99ab26573a69 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1508 microversion: 2.1 time: 0.139756 Aug 10 05:26:22.300646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 519/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:22 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:22.315956 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-cdf4046a-7457-4cfd-84ae-0a852ec88c64 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2db82d43-7143-4e2e-8868-6987dbbf7360", "device": "/dev/sdb"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:22.317079 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-cdf4046a-7457-4cfd-84ae-0a852ec88c64 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:22.323287 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cdf4046a-7457-4cfd-84ae-0a852ec88c64 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:22.323745 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cdf4046a-7457-4cfd-84ae-0a852ec88c64 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:22.325848 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cdf4046a-7457-4cfd-84ae-0a852ec88c64 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:22.326302 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cdf4046a-7457-4cfd-84ae-0a852ec88c64 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:22.877220 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-cdf4046a-7457-4cfd-84ae-0a852ec88c64 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "POST /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.564705 Aug 10 05:26:22.877753 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 523/1042] 10.222.0.16 () {60 vars in 1323 bytes} [Tue Aug 10 05:26:22 2021] POST /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:24.698632 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f1d752c8-cbce-4220-9fce-86d465051fce tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1016596095"}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:24.699181 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f1d752c8-cbce-4220-9fce-86d465051fce tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:24.705036 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f1d752c8-cbce-4220-9fce-86d465051fce tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:24.705482 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f1d752c8-cbce-4220-9fce-86d465051fce tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:24.706239 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f1d752c8-cbce-4220-9fce-86d465051fce tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:24.706707 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f1d752c8-cbce-4220-9fce-86d465051fce tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:24.823718 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.network.security_group_api [None req-f1d752c8-cbce-4220-9fce-86d465051fce tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Removing security group fadd5a6b-fd27-4f64-af75-7e62b56942a5 from port 076ea264-6ca7-4640-a5cc-e7faa9876c93 Aug 10 05:26:25.206107 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f1d752c8-cbce-4220-9fce-86d465051fce tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "POST /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/action" status: 202 len: 0 microversion: 2.1 time: 0.511196 Aug 10 05:26:25.207535 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 520/1043] 10.222.0.16 () {60 vars in 1278 bytes} [Tue Aug 10 05:26:24 2021] POST /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:26:25.217878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-eba0a6f9-234d-4117-b85f-a5bc717cb00b req-7b1e2c4f-5ee0-4416-a25f-0f840dd8860d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511b4fd6-05af-42c8-b691-4926486f6f50", "tag": "076ea264-6ca7-4640-a5cc-e7faa9876c93"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:25.220557 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:26:25.220557 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:26:25.231681 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-eba0a6f9-234d-4117-b85f-a5bc717cb00b req-7b1e2c4f-5ee0-4416-a25f-0f840dd8860d service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:25.232451 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-eba0a6f9-234d-4117-b85f-a5bc717cb00b req-7b1e2c4f-5ee0-4416-a25f-0f840dd8860d service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:25.245556 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-eba0a6f9-234d-4117-b85f-a5bc717cb00b req-7b1e2c4f-5ee0-4416-a25f-0f840dd8860d service nova] Creating event network-changed:076ea264-6ca7-4640-a5cc-e7faa9876c93 for instance 511b4fd6-05af-42c8-b691-4926486f6f50 on hv-cinder-80390 Aug 10 05:26:25.253184 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-eba0a6f9-234d-4117-b85f-a5bc717cb00b req-7b1e2c4f-5ee0-4416-a25f-0f840dd8860d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040178 Aug 10 05:26:25.258708 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 524/1044] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:26:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 05:26:26.658982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ad8ec32b-9154-48ef-9062-d815e3922571 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:26.659609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ad8ec32b-9154-48ef-9062-d815e3922571 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:26.660145 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-6f54a3ce-66c4-4f53-8cc2-6c6ca759a0a8 req-3c0157ce-df34-45ac-bd90-aa67d38c77bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "511b4fd6-05af-42c8-b691-4926486f6f50", "tag": "076ea264-6ca7-4640-a5cc-e7faa9876c93"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:26.663011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:26:26.663011 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:26:26.666024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad8ec32b-9154-48ef-9062-d815e3922571 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:26.666618 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad8ec32b-9154-48ef-9062-d815e3922571 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:26.667584 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad8ec32b-9154-48ef-9062-d815e3922571 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:26.668224 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ad8ec32b-9154-48ef-9062-d815e3922571 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:26.670182 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-6f54a3ce-66c4-4f53-8cc2-6c6ca759a0a8 req-3c0157ce-df34-45ac-bd90-aa67d38c77bf service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:26.670830 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-6f54a3ce-66c4-4f53-8cc2-6c6ca759a0a8 req-3c0157ce-df34-45ac-bd90-aa67d38c77bf service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:26.681786 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-6f54a3ce-66c4-4f53-8cc2-6c6ca759a0a8 req-3c0157ce-df34-45ac-bd90-aa67d38c77bf service nova] Creating event network-changed:076ea264-6ca7-4640-a5cc-e7faa9876c93 for instance 511b4fd6-05af-42c8-b691-4926486f6f50 on hv-cinder-80390 Aug 10 05:26:26.687223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-6f54a3ce-66c4-4f53-8cc2-6c6ca759a0a8 req-3c0157ce-df34-45ac-bd90-aa67d38c77bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030894 Aug 10 05:26:26.688049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 525/1045] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:26:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:26.761581 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-ad8ec32b-9154-48ef-9062-d815e3922571 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lazy-loading 'services' on Instance uuid 511b4fd6-05af-42c8-b691-4926486f6f50 {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:26:26.923799 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ad8ec32b-9154-48ef-9062-d815e3922571 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments/82bc478d-771a-47e7-94ca-a020f4c61951" status: 202 len: 0 microversion: 2.1 time: 0.269976 Aug 10 05:26:26.927822 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 521/1046] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:26:26 2021] DELETE /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments/82bc478d-771a-47e7-94ca-a020f4c61951 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:26:26.935360 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-46e3f340-f7c5-4ecd-9028-cf2ba024799c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:26.936828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-46e3f340-f7c5-4ecd-9028-cf2ba024799c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:26.945076 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46e3f340-f7c5-4ecd-9028-cf2ba024799c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:26.945959 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46e3f340-f7c5-4ecd-9028-cf2ba024799c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:26.947067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46e3f340-f7c5-4ecd-9028-cf2ba024799c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:26.947730 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-46e3f340-f7c5-4ecd-9028-cf2ba024799c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:26.981019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-46e3f340-f7c5-4ecd-9028-cf2ba024799c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051420 Aug 10 05:26:26.985829 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 526/1047] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:26:26 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:27.993675 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-fd7b11c7-f45e-447f-accf-e1307b68bfc0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:27.994782 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-fd7b11c7-f45e-447f-accf-e1307b68bfc0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:28.001016 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fd7b11c7-f45e-447f-accf-e1307b68bfc0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:28.001378 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fd7b11c7-f45e-447f-accf-e1307b68bfc0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:28.002143 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fd7b11c7-f45e-447f-accf-e1307b68bfc0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:28.002599 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-fd7b11c7-f45e-447f-accf-e1307b68bfc0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:28.031818 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-fd7b11c7-f45e-447f-accf-e1307b68bfc0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042274 Aug 10 05:26:28.032381 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 522/1048] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:26:27 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:29.043945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d77ce221-ae8f-4dad-9ba1-860c28d556e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:29.053362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d77ce221-ae8f-4dad-9ba1-860c28d556e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:29.053362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d77ce221-ae8f-4dad-9ba1-860c28d556e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:29.053362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d77ce221-ae8f-4dad-9ba1-860c28d556e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:29.053362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d77ce221-ae8f-4dad-9ba1-860c28d556e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:29.053755 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d77ce221-ae8f-4dad-9ba1-860c28d556e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:29.080488 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d77ce221-ae8f-4dad-9ba1-860c28d556e8 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041004 Aug 10 05:26:29.081039 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 527/1049] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:26:29 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:30.091951 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-50b709c8-db38-485a-abec-cdf09ead86ca tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:30.092852 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-50b709c8-db38-485a-abec-cdf09ead86ca tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:30.098738 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50b709c8-db38-485a-abec-cdf09ead86ca tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:30.099190 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50b709c8-db38-485a-abec-cdf09ead86ca tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:30.099954 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50b709c8-db38-485a-abec-cdf09ead86ca tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:30.100387 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-50b709c8-db38-485a-abec-cdf09ead86ca tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:30.132489 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-50b709c8-db38-485a-abec-cdf09ead86ca tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Aug 10 05:26:30.133054 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 523/1050] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:26:30 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:31.144371 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-78e410fb-914b-4ad7-b3f2-ef938b8bf71c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:31.145286 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-78e410fb-914b-4ad7-b3f2-ef938b8bf71c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:31.151164 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-78e410fb-914b-4ad7-b3f2-ef938b8bf71c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:31.151616 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-78e410fb-914b-4ad7-b3f2-ef938b8bf71c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:31.152433 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-78e410fb-914b-4ad7-b3f2-ef938b8bf71c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:31.152872 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-78e410fb-914b-4ad7-b3f2-ef938b8bf71c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:31.179748 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-78e410fb-914b-4ad7-b3f2-ef938b8bf71c tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039186 Aug 10 05:26:31.180289 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 528/1051] 10.222.0.16 () {58 vars in 1302 bytes} [Tue Aug 10 05:26:31 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments => generated 25 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 05:26:31.190151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:31.190668 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:31.196330 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:31.196781 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:31.197545 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:31.197984 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:31.274220 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] HTTP exception thrown: Instance 511b4fd6-05af-42c8-b691-4926486f6f50 is not attached to volume 82bc478d-771a-47e7-94ca-a020f4c61951 Aug 10 05:26:31.274853 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Returning 404 to user: Instance 511b4fd6-05af-42c8-b691-4926486f6f50 is not attached to volume 82bc478d-771a-47e7-94ca-a020f4c61951 {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:26:31.275708 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4d2e0384-21da-401a-b852-bd51c77645c0 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments/82bc478d-771a-47e7-94ca-a020f4c61951" status: 404 len: 154 microversion: 2.1 time: 0.089331 Aug 10 05:26:31.276320 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 524/1052] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:26:31 2021] DELETE /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50/os-volume_attachments/82bc478d-771a-47e7-94ca-a020f4c61951 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:26:34.646131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-558c5732-e831-4cc0-ac33-8aec0a1917e1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:34.646655 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-558c5732-e831-4cc0-ac33-8aec0a1917e1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:34.653454 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-558c5732-e831-4cc0-ac33-8aec0a1917e1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:34.653906 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-558c5732-e831-4cc0-ac33-8aec0a1917e1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:34.654710 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-558c5732-e831-4cc0-ac33-8aec0a1917e1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:34.655147 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-558c5732-e831-4cc0-ac33-8aec0a1917e1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:34.678404 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-558c5732-e831-4cc0-ac33-8aec0a1917e1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:26:34.946554 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-558c5732-e831-4cc0-ac33-8aec0a1917e1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "DELETE /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 204 len: 0 microversion: 2.1 time: 0.303782 Aug 10 05:26:34.947188 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 529/1053] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:26:34 2021] DELETE /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:26:34.955630 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-70475921-d0b7-40b7-87fc-3387913c8ac2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:34.956247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-70475921-d0b7-40b7-87fc-3387913c8ac2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:34.961974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-70475921-d0b7-40b7-87fc-3387913c8ac2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:34.962422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-70475921-d0b7-40b7-87fc-3387913c8ac2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:34.963231 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-70475921-d0b7-40b7-87fc-3387913c8ac2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:34.963672 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-70475921-d0b7-40b7-87fc-3387913c8ac2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:35.084369 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-70475921-d0b7-40b7-87fc-3387913c8ac2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:35.092720 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-70475921-d0b7-40b7-87fc-3387913c8ac2 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1556 microversion: 2.1 time: 0.140679 Aug 10 05:26:35.097012 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 525/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:34 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1556 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:36.110126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c2d38dbf-d997-4409-9fa0-471f6bd9064f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:36.110923 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c2d38dbf-d997-4409-9fa0-471f6bd9064f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:36.116739 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c2d38dbf-d997-4409-9fa0-471f6bd9064f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:36.117183 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c2d38dbf-d997-4409-9fa0-471f6bd9064f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:36.117940 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c2d38dbf-d997-4409-9fa0-471f6bd9064f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:36.118371 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c2d38dbf-d997-4409-9fa0-471f6bd9064f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:36.234311 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c2d38dbf-d997-4409-9fa0-471f6bd9064f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:36.241784 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c2d38dbf-d997-4409-9fa0-471f6bd9064f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1556 microversion: 2.1 time: 0.135956 Aug 10 05:26:36.242343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 530/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:36 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1556 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:37.257907 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-07eb3728-bbe2-405f-a143-998e23ee016f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:37.258518 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-07eb3728-bbe2-405f-a143-998e23ee016f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:37.264407 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-07eb3728-bbe2-405f-a143-998e23ee016f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:37.264860 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-07eb3728-bbe2-405f-a143-998e23ee016f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:37.265631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-07eb3728-bbe2-405f-a143-998e23ee016f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:37.266069 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-07eb3728-bbe2-405f-a143-998e23ee016f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:37.381809 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-07eb3728-bbe2-405f-a143-998e23ee016f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:37.388988 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-07eb3728-bbe2-405f-a143-998e23ee016f tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1556 microversion: 2.1 time: 0.134728 Aug 10 05:26:37.389548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 526/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:37 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1556 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:38.405647 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-5584f376-c373-4948-9df3-84e18cf51bc1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:38.406210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-5584f376-c373-4948-9df3-84e18cf51bc1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:38.412789 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5584f376-c373-4948-9df3-84e18cf51bc1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:38.413586 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5584f376-c373-4948-9df3-84e18cf51bc1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:38.414968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5584f376-c373-4948-9df3-84e18cf51bc1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:38.415732 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-5584f376-c373-4948-9df3-84e18cf51bc1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:38.532140 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-5584f376-c373-4948-9df3-84e18cf51bc1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:38.539438 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-5584f376-c373-4948-9df3-84e18cf51bc1 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1556 microversion: 2.1 time: 0.137561 Aug 10 05:26:38.540000 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 531/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:38 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1556 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:39.371158 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-3ae8da4f-b138-409f-ad27-ed5282b25e26 req-51d49aa3-64c5-4593-b421-0288e1b450c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "511b4fd6-05af-42c8-b691-4926486f6f50", "name": "network-vif-deleted", "tag": "076ea264-6ca7-4640-a5cc-e7faa9876c93"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:39.372655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:26:39.372655 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:26:39.379588 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-3ae8da4f-b138-409f-ad27-ed5282b25e26 req-51d49aa3-64c5-4593-b421-0288e1b450c6 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:39.380028 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-3ae8da4f-b138-409f-ad27-ed5282b25e26 req-51d49aa3-64c5-4593-b421-0288e1b450c6 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:39.391629 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-3ae8da4f-b138-409f-ad27-ed5282b25e26 req-51d49aa3-64c5-4593-b421-0288e1b450c6 service nova] Creating event network-vif-deleted:076ea264-6ca7-4640-a5cc-e7faa9876c93 for instance 511b4fd6-05af-42c8-b691-4926486f6f50 on hv-cinder-80390 Aug 10 05:26:39.398774 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-3ae8da4f-b138-409f-ad27-ed5282b25e26 req-51d49aa3-64c5-4593-b421-0288e1b450c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031916 Aug 10 05:26:39.399513 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 527/1058] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:26:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:39.556505 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:39.557193 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:39.563811 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:39.564267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:39.565075 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:39.565512 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:39.597453 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:39.597828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:39.598273 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.objects.instance [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lazy-loading 'fault' on Instance uuid 511b4fd6-05af-42c8-b691-4926486f6f50 {{(pid=108136) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:26:39.639832 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b1ae97ac20846f98584751422f8373b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6a28118fed4568a62deb8f8326a3ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:39.647367 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d625c2b8-15d2-44dc-b0df-8dadba91391d tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 200 len: 1349 microversion: 2.1 time: 0.094558 Aug 10 05:26:39.647965 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 532/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:39 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 1349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:26:40.665462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:40.666214 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [instance: 511b4fd6-05af-42c8-b691-4926486f6f50] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:40.672766 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:40.674758 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:40.674758 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:40.674758 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:40.687916 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] HTTP exception thrown: Instance 511b4fd6-05af-42c8-b691-4926486f6f50 could not be found. Aug 10 05:26:40.688491 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Returning 404 to user: Instance 511b4fd6-05af-42c8-b691-4926486f6f50 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:26:40.689295 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2ad1aecb-b8fe-4aa3-93d0-a4b5b7b0e942 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50" status: 404 len: 111 microversion: 2.1 time: 0.028037 Aug 10 05:26:40.689800 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 528/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:40 2021] GET /compute/v2.1/servers/511b4fd6-05af-42c8-b691-4926486f6f50 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:26:40.697659 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-826d18ce-497f-4afd-a941-75f85560d666 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] Calling method '.version_select at 0x7fb33c2730d0>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:40.701105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: ERROR oslo.messaging._drivers.impl_rabbit [None req-826d18ce-497f-4afd-a941-75f85560d666 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [c2d35687-d10b-49be-86b5-831f4bc03f91] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 05:26:41.717662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [None req-826d18ce-497f-4afd-a941-75f85560d666 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] [c2d35687-d10b-49be-86b5-831f4bc03f91] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 60970. Aug 10 05:26:41.771002 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-826d18ce-497f-4afd-a941-75f85560d666 tempest-TestMinimumBasicScenario-526515989 tempest-TestMinimumBasicScenario-526515989-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1527843142" status: 202 len: 0 microversion: 2.1 time: 1.076810 Aug 10 05:26:41.771641 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 533/1061] 10.222.0.16 () {58 vars in 1272 bytes} [Tue Aug 10 05:26:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1527843142 => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 05:26:42.703484 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-1666a0e7-6500-4fcf-8e02-a8bbac94c552 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:42.704083 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-1666a0e7-6500-4fcf-8e02-a8bbac94c552 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:42.709864 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1666a0e7-6500-4fcf-8e02-a8bbac94c552 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:42.710295 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1666a0e7-6500-4fcf-8e02-a8bbac94c552 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:42.711100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1666a0e7-6500-4fcf-8e02-a8bbac94c552 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:42.711549 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-1666a0e7-6500-4fcf-8e02-a8bbac94c552 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:42.796708 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-1666a0e7-6500-4fcf-8e02-a8bbac94c552 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lazy-loading 'services' on Instance uuid c9839787-25a1-4a03-b3db-d8633dd295f5 {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:26:43.008390 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-1666a0e7-6500-4fcf-8e02-a8bbac94c552 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5/os-volume_attachments/2db82d43-7143-4e2e-8868-6987dbbf7360" status: 202 len: 0 microversion: 2.1 time: 0.309165 Aug 10 05:26:43.008978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 529/1062] 10.222.0.16 () {58 vars in 1416 bytes} [Tue Aug 10 05:26:42 2021] DELETE /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5/os-volume_attachments/2db82d43-7143-4e2e-8868-6987dbbf7360 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:26:44.127301 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-59bf8e03-a81d-4107-8511-27df8124c697 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:44.127863 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-59bf8e03-a81d-4107-8511-27df8124c697 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:44.134685 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-59bf8e03-a81d-4107-8511-27df8124c697 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:44.135143 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-59bf8e03-a81d-4107-8511-27df8124c697 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:44.135966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-59bf8e03-a81d-4107-8511-27df8124c697 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:44.136456 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-59bf8e03-a81d-4107-8511-27df8124c697 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:44.161375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-59bf8e03-a81d-4107-8511-27df8124c697 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:26:44.449998 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-59bf8e03-a81d-4107-8511-27df8124c697 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 204 len: 0 microversion: 2.1 time: 0.326513 Aug 10 05:26:44.450825 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 534/1063] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:26:44 2021] DELETE /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:26:44.459633 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-f6f55669-4e99-4efe-9839-de795ba2ad1a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:44.460926 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-f6f55669-4e99-4efe-9839-de795ba2ad1a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:44.469513 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f6f55669-4e99-4efe-9839-de795ba2ad1a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:44.470359 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f6f55669-4e99-4efe-9839-de795ba2ad1a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:44.471229 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f6f55669-4e99-4efe-9839-de795ba2ad1a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:44.471670 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-f6f55669-4e99-4efe-9839-de795ba2ad1a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:44.605814 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-f6f55669-4e99-4efe-9839-de795ba2ad1a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:44.624739 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-f6f55669-4e99-4efe-9839-de795ba2ad1a tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1514 microversion: 2.1 time: 0.157848 Aug 10 05:26:44.624739 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 530/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:44 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:45.630690 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-12c05dde-f37c-4174-998c-ae1dc493f934 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:45.631520 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-12c05dde-f37c-4174-998c-ae1dc493f934 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:45.638042 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12c05dde-f37c-4174-998c-ae1dc493f934 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:45.638625 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12c05dde-f37c-4174-998c-ae1dc493f934 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:45.639503 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12c05dde-f37c-4174-998c-ae1dc493f934 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:45.640050 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-12c05dde-f37c-4174-998c-ae1dc493f934 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:45.778343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-12c05dde-f37c-4174-998c-ae1dc493f934 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:45.791150 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-12c05dde-f37c-4174-998c-ae1dc493f934 tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1514 microversion: 2.1 time: 0.164435 Aug 10 05:26:45.791923 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 535/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:45 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:46.724049 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-14784d27-9725-4a7e-b68f-c1038b9062c7 req-221065bd-b971-4c3c-b3f0-eac7790f3fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9839787-25a1-4a03-b3db-d8633dd295f5", "name": "network-vif-deleted", "tag": "a1a18f56-2e81-4442-91f2-51b8d12fc27a"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:26:46.732110 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:26:46.732110 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:26:46.739351 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-14784d27-9725-4a7e-b68f-c1038b9062c7 req-221065bd-b971-4c3c-b3f0-eac7790f3fd2 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:46.740329 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-14784d27-9725-4a7e-b68f-c1038b9062c7 req-221065bd-b971-4c3c-b3f0-eac7790f3fd2 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:46.751082 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-14784d27-9725-4a7e-b68f-c1038b9062c7 req-221065bd-b971-4c3c-b3f0-eac7790f3fd2 service nova] Creating event network-vif-deleted:a1a18f56-2e81-4442-91f2-51b8d12fc27a for instance c9839787-25a1-4a03-b3db-d8633dd295f5 on hv-cinder-80390 Aug 10 05:26:46.756116 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-14784d27-9725-4a7e-b68f-c1038b9062c7 req-221065bd-b971-4c3c-b3f0-eac7790f3fd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Aug 10 05:26:46.757520 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 531/1066] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:26:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:26:46.807992 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-f1eb08bc-26b3-422f-9594-3aff82430c2f tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:46.808539 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-f1eb08bc-26b3-422f-9594-3aff82430c2f tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:46.814337 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f1eb08bc-26b3-422f-9594-3aff82430c2f tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:46.814828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f1eb08bc-26b3-422f-9594-3aff82430c2f tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:46.815612 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f1eb08bc-26b3-422f-9594-3aff82430c2f tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:46.816049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-f1eb08bc-26b3-422f-9594-3aff82430c2f tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:46.878447 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-f1eb08bc-26b3-422f-9594-3aff82430c2f tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55db5c11bf8440939f0fc49dd1ec23fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58f808282d0435887cb9b2387e33199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:26:46.885904 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-f1eb08bc-26b3-422f-9594-3aff82430c2f tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 200 len: 1472 microversion: 2.1 time: 0.081798 Aug 10 05:26:46.887022 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 536/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:46 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:26:47.904297 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:26:47.904987 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] [instance: c9839787-25a1-4a03-b3db-d8633dd295f5] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:26:47.911556 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:47.911775 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:47.912547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:26:47.912983 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:26:47.926811 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] HTTP exception thrown: Instance c9839787-25a1-4a03-b3db-d8633dd295f5 could not be found. Aug 10 05:26:47.927395 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] Returning 404 to user: Instance c9839787-25a1-4a03-b3db-d8633dd295f5 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:26:47.928211 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a758fee8-6d86-4967-9452-ea239e57aaea tempest-VolumesSnapshotTestJSON-1434044114 tempest-VolumesSnapshotTestJSON-1434044114-project] 10.222.0.16 "GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5" status: 404 len: 111 microversion: 2.1 time: 0.028507 Aug 10 05:26:47.928741 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 532/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:26:47 2021] GET /compute/v2.1/servers/c9839787-25a1-4a03-b3db-d8633dd295f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:27:18.858356 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:27:18.859041 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:27:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:27:26.397797 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b085ccbd-6869-4e19-bbc8-78dcd3801f8c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Action: 'create', calling method: .version_select at 0x7fb33c390d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-870744261"}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:27:26.422034 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-b085ccbd-6869-4e19-bbc8-78dcd3801f8c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for project e654b562fb1b41608bcc31ea569d9473. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:27:26.426172 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-b085ccbd-6869-4e19-bbc8-78dcd3801f8c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for user cbff6c12349d4e03988d56e7aad5982b and project e654b562fb1b41608bcc31ea569d9473. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:27:26.762704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-b085ccbd-6869-4e19-bbc8-78dcd3801f8c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for project e654b562fb1b41608bcc31ea569d9473. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:27:26.766888 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-b085ccbd-6869-4e19-bbc8-78dcd3801f8c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for user cbff6c12349d4e03988d56e7aad5982b and project e654b562fb1b41608bcc31ea569d9473. Resources: {'key_pairs'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:27:26.780053 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b085ccbd-6869-4e19-bbc8-78dcd3801f8c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.579428 Aug 10 05:27:26.780668 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 537/1069] 10.222.0.16 () {60 vars in 1158 bytes} [Tue Aug 10 05:27:26 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:47.886504 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-371133517", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-870744261", "security_groups": [{"name": "tempest-secgroup-smoke-1701116513"}], "block_device_mapping_v2": [{"uuid": "21c40c8e-ef11-4939-bb02-4d56c5c86dfe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7cab1640-2f85-4ddc-abce-156c1a17acda"}]}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:27:47.894995 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 05:27:47.987602 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] validate_networks() for [('7cab1640-2f85-4ddc-abce-156c1a17acda', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:27:48.435091 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:27:48.435515 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:27:48.435991 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:27:48.436397 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:27:48.436804 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:27:48.445722 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:48.446173 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:48.447008 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:48.447438 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:48.463554 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for project e654b562fb1b41608bcc31ea569d9473. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:27:48.467342 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for user cbff6c12349d4e03988d56e7aad5982b and project e654b562fb1b41608bcc31ea569d9473. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:27:48.526048 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:27:48.528273 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21c40c8e-ef11-4939-bb02-4d56c5c86dfe',volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:27:48.911852 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33172. Aug 10 05:27:48.958723 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-d94d1e13-e657-4c52-b0f3-35d896488b4d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.075861 Aug 10 05:27:48.959298 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 533/1070] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:27:47 2021] POST /compute/v2.1/servers => generated 406 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:27:48.969407 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-704c944b-0b5c-4850-ac4e-9c71ddb759b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:48.970025 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-704c944b-0b5c-4850-ac4e-9c71ddb759b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:49.020825 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-704c944b-0b5c-4850-ac4e-9c71ddb759b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:49.028091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-704c944b-0b5c-4850-ac4e-9c71ddb759b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1093 microversion: 2.1 time: 0.062619 Aug 10 05:27:49.028644 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 538/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:48 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:50.044553 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-06fc2f5b-0cd9-420e-9c77-ec5a52ff72dc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:50.045070 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-06fc2f5b-0cd9-420e-9c77-ec5a52ff72dc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:50.095695 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-06fc2f5b-0cd9-420e-9c77-ec5a52ff72dc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:50.102430 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-06fc2f5b-0cd9-420e-9c77-ec5a52ff72dc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1093 microversion: 2.1 time: 0.061614 Aug 10 05:27:50.103003 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 534/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:50 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1093 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:51.118348 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-96b70657-70f9-4215-84bd-b4234007f3cd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:51.118978 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-96b70657-70f9-4215-84bd-b4234007f3cd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:51.124829 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-96b70657-70f9-4215-84bd-b4234007f3cd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:51.125272 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-96b70657-70f9-4215-84bd-b4234007f3cd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:51.126028 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-96b70657-70f9-4215-84bd-b4234007f3cd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:51.126460 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-96b70657-70f9-4215-84bd-b4234007f3cd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:51.184543 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-96b70657-70f9-4215-84bd-b4234007f3cd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:51.191788 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-96b70657-70f9-4215-84bd-b4234007f3cd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1191 microversion: 2.1 time: 0.077144 Aug 10 05:27:51.192352 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 539/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:51 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1191 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:52.213006 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-10b94509-2a72-4271-806d-7f9392df82f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:52.213624 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-10b94509-2a72-4271-806d-7f9392df82f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:52.219912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-10b94509-2a72-4271-806d-7f9392df82f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:52.220374 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-10b94509-2a72-4271-806d-7f9392df82f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:52.221154 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-10b94509-2a72-4271-806d-7f9392df82f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:52.221644 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-10b94509-2a72-4271-806d-7f9392df82f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:52.422238 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-10b94509-2a72-4271-806d-7f9392df82f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:52.430860 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-10b94509-2a72-4271-806d-7f9392df82f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1277 microversion: 2.1 time: 0.224714 Aug 10 05:27:52.431457 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 535/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:52 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:52.931327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-4861889f-6a06-4f03-890d-b776dd8a7612 req-97caa8c7-194d-4376-8438-9414d2b12f94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3651b0a-2a69-4504-af5a-734e98762539", "tag": "c82a6b32-3037-4286-bb2b-18dd88ac720a"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:27:52.932910 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:27:52.932910 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:27:52.940540 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-4861889f-6a06-4f03-890d-b776dd8a7612 req-97caa8c7-194d-4376-8438-9414d2b12f94 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:52.940986 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-4861889f-6a06-4f03-890d-b776dd8a7612 req-97caa8c7-194d-4376-8438-9414d2b12f94 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:52.953109 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-4861889f-6a06-4f03-890d-b776dd8a7612 req-97caa8c7-194d-4376-8438-9414d2b12f94 service nova] Creating event network-changed:c82a6b32-3037-4286-bb2b-18dd88ac720a for instance f3651b0a-2a69-4504-af5a-734e98762539 on hv-cinder-80390 Aug 10 05:27:52.958947 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-4861889f-6a06-4f03-890d-b776dd8a7612 req-97caa8c7-194d-4376-8438-9414d2b12f94 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089864 Aug 10 05:27:52.959630 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 540/1075] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:27:53.448548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-e2a86591-6192-4fab-8a0c-fddf4dcd2bda tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:53.449143 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-e2a86591-6192-4fab-8a0c-fddf4dcd2bda tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:53.455285 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e2a86591-6192-4fab-8a0c-fddf4dcd2bda tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:53.455736 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e2a86591-6192-4fab-8a0c-fddf4dcd2bda tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:53.456513 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e2a86591-6192-4fab-8a0c-fddf4dcd2bda tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:53.456945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-e2a86591-6192-4fab-8a0c-fddf4dcd2bda tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:53.671721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-e2a86591-6192-4fab-8a0c-fddf4dcd2bda tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:53.679723 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-e2a86591-6192-4fab-8a0c-fddf4dcd2bda tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.234944 Aug 10 05:27:53.680332 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 536/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:53 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:54.697628 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-354d3a3c-3668-4836-b2de-1dd8c2dd8319 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:54.698321 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-354d3a3c-3668-4836-b2de-1dd8c2dd8319 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:54.704378 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-354d3a3c-3668-4836-b2de-1dd8c2dd8319 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:54.704827 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-354d3a3c-3668-4836-b2de-1dd8c2dd8319 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:54.705614 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-354d3a3c-3668-4836-b2de-1dd8c2dd8319 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:54.706048 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-354d3a3c-3668-4836-b2de-1dd8c2dd8319 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:54.824766 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-354d3a3c-3668-4836-b2de-1dd8c2dd8319 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:54.831883 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-354d3a3c-3668-4836-b2de-1dd8c2dd8319 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.138276 Aug 10 05:27:54.832441 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 541/1077] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:54 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:55.847982 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7d6e6438-99ee-4c6d-b0c2-b9c4103dc082 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:55.849102 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7d6e6438-99ee-4c6d-b0c2-b9c4103dc082 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:55.854865 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7d6e6438-99ee-4c6d-b0c2-b9c4103dc082 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:55.855314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7d6e6438-99ee-4c6d-b0c2-b9c4103dc082 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:55.856071 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7d6e6438-99ee-4c6d-b0c2-b9c4103dc082 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:55.856502 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7d6e6438-99ee-4c6d-b0c2-b9c4103dc082 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:55.972097 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7d6e6438-99ee-4c6d-b0c2-b9c4103dc082 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:55.979243 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7d6e6438-99ee-4c6d-b0c2-b9c4103dc082 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.135039 Aug 10 05:27:55.979794 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 537/1078] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:55 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:56.996475 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-161c1864-842e-4ca8-bc32-29d2ef0a9edc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:56.997119 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-161c1864-842e-4ca8-bc32-29d2ef0a9edc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:57.002956 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-161c1864-842e-4ca8-bc32-29d2ef0a9edc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:57.003408 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-161c1864-842e-4ca8-bc32-29d2ef0a9edc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:57.004171 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-161c1864-842e-4ca8-bc32-29d2ef0a9edc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:57.004609 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-161c1864-842e-4ca8-bc32-29d2ef0a9edc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:57.124643 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-161c1864-842e-4ca8-bc32-29d2ef0a9edc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:57.132062 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-161c1864-842e-4ca8-bc32-29d2ef0a9edc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.139176 Aug 10 05:27:57.132639 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 542/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:56 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:58.148454 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-71289dbf-275a-43a6-bb0a-54453fc218b1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:58.149068 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-71289dbf-275a-43a6-bb0a-54453fc218b1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:58.154887 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-71289dbf-275a-43a6-bb0a-54453fc218b1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:58.155336 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-71289dbf-275a-43a6-bb0a-54453fc218b1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:58.156100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-71289dbf-275a-43a6-bb0a-54453fc218b1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:58.156541 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-71289dbf-275a-43a6-bb0a-54453fc218b1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:58.277330 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-71289dbf-275a-43a6-bb0a-54453fc218b1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:58.284626 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-71289dbf-275a-43a6-bb0a-54453fc218b1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.139862 Aug 10 05:27:58.285191 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 538/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:58 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:27:59.301059 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-e5b8d5e7-70be-45f9-bbab-c41d32f0f1ad tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:27:59.302222 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-e5b8d5e7-70be-45f9-bbab-c41d32f0f1ad tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:27:59.308049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e5b8d5e7-70be-45f9-bbab-c41d32f0f1ad tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:59.308501 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e5b8d5e7-70be-45f9-bbab-c41d32f0f1ad tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:59.309319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e5b8d5e7-70be-45f9-bbab-c41d32f0f1ad tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:27:59.309750 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-e5b8d5e7-70be-45f9-bbab-c41d32f0f1ad tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:27:59.424777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-e5b8d5e7-70be-45f9-bbab-c41d32f0f1ad tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:27:59.432401 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-e5b8d5e7-70be-45f9-bbab-c41d32f0f1ad tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.135004 Aug 10 05:27:59.432968 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 543/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:27:59 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:28:00.448766 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a16abe88-762f-4070-adcf-3606254745dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:28:00.449384 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a16abe88-762f-4070-adcf-3606254745dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:28:00.455395 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a16abe88-762f-4070-adcf-3606254745dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:00.455874 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a16abe88-762f-4070-adcf-3606254745dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:00.456634 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a16abe88-762f-4070-adcf-3606254745dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:00.457083 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a16abe88-762f-4070-adcf-3606254745dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:00.582539 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a16abe88-762f-4070-adcf-3606254745dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:28:00.594551 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a16abe88-762f-4070-adcf-3606254745dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.149162 Aug 10 05:28:00.595465 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 539/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:28:00 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:28:01.611517 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-fcd2aa21-a03c-426d-947f-0b05a819a9e2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:28:01.612152 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-fcd2aa21-a03c-426d-947f-0b05a819a9e2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:28:01.618236 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fcd2aa21-a03c-426d-947f-0b05a819a9e2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:01.618784 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fcd2aa21-a03c-426d-947f-0b05a819a9e2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:01.619896 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fcd2aa21-a03c-426d-947f-0b05a819a9e2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:01.620620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-fcd2aa21-a03c-426d-947f-0b05a819a9e2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:01.737559 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-fcd2aa21-a03c-426d-947f-0b05a819a9e2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:28:01.744707 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-fcd2aa21-a03c-426d-947f-0b05a819a9e2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.137119 Aug 10 05:28:01.745271 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 544/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:28:01 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:28:02.251915 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-626872f8-0da2-4231-bdf1-9869ebb3b75a req-5c5217ff-aa10-4c60-9f2f-245ab762262a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3651b0a-2a69-4504-af5a-734e98762539", "name": "network-vif-plugged", "status": "completed", "tag": "c82a6b32-3037-4286-bb2b-18dd88ac720a"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:28:02.253507 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:28:02.253507 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:28:02.260784 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-626872f8-0da2-4231-bdf1-9869ebb3b75a req-5c5217ff-aa10-4c60-9f2f-245ab762262a service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:02.261222 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-626872f8-0da2-4231-bdf1-9869ebb3b75a req-5c5217ff-aa10-4c60-9f2f-245ab762262a service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:02.272444 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-626872f8-0da2-4231-bdf1-9869ebb3b75a req-5c5217ff-aa10-4c60-9f2f-245ab762262a service nova] Creating event network-vif-plugged:c82a6b32-3037-4286-bb2b-18dd88ac720a for instance f3651b0a-2a69-4504-af5a-734e98762539 on hv-cinder-80390 Aug 10 05:28:02.277557 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-626872f8-0da2-4231-bdf1-9869ebb3b75a req-5c5217ff-aa10-4c60-9f2f-245ab762262a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029248 Aug 10 05:28:02.278143 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 540/1084] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:28:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:28:02.761330 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-105c511c-57f5-45a2-921f-b8d162dce894 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:28:02.761942 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-105c511c-57f5-45a2-921f-b8d162dce894 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:28:02.767764 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-105c511c-57f5-45a2-921f-b8d162dce894 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:02.768214 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-105c511c-57f5-45a2-921f-b8d162dce894 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:02.769007 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-105c511c-57f5-45a2-921f-b8d162dce894 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:02.769445 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-105c511c-57f5-45a2-921f-b8d162dce894 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:02.893838 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-105c511c-57f5-45a2-921f-b8d162dce894 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:28:02.902698 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-105c511c-57f5-45a2-921f-b8d162dce894 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1265 microversion: 2.1 time: 0.144477 Aug 10 05:28:02.911310 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 545/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:28:02 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:28:03.920328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4eff6937-199f-47aa-81ca-177bd19c4570 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:28:03.920957 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4eff6937-199f-47aa-81ca-177bd19c4570 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:28:03.926928 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4eff6937-199f-47aa-81ca-177bd19c4570 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:03.927371 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4eff6937-199f-47aa-81ca-177bd19c4570 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:03.928127 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4eff6937-199f-47aa-81ca-177bd19c4570 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:03.928586 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4eff6937-199f-47aa-81ca-177bd19c4570 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:04.046305 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4eff6937-199f-47aa-81ca-177bd19c4570 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:28:04.053555 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4eff6937-199f-47aa-81ca-177bd19c4570 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1453 microversion: 2.1 time: 0.137369 Aug 10 05:28:04.054117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 541/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:28:03 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:28:04.068998 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-dfa8f531-f52d-4495-b03a-09e2a7abc7e0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:28:04.069623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-dfa8f531-f52d-4495-b03a-09e2a7abc7e0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:28:04.075372 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dfa8f531-f52d-4495-b03a-09e2a7abc7e0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:04.075829 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dfa8f531-f52d-4495-b03a-09e2a7abc7e0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:04.076597 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dfa8f531-f52d-4495-b03a-09e2a7abc7e0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:04.077040 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-dfa8f531-f52d-4495-b03a-09e2a7abc7e0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:04.192715 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-dfa8f531-f52d-4495-b03a-09e2a7abc7e0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:28:04.199810 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-dfa8f531-f52d-4495-b03a-09e2a7abc7e0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1453 microversion: 2.1 time: 0.134524 Aug 10 05:28:04.200396 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 546/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:28:04 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1453 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:28:06.101327 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-f371348f-b016-43f2-91de-a444dd701434 req-1bc38923-dc09-47fb-b89b-43a906b92861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3651b0a-2a69-4504-af5a-734e98762539", "tag": "c82a6b32-3037-4286-bb2b-18dd88ac720a"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:28:06.103427 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:28:06.103427 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:28:06.109751 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-f371348f-b016-43f2-91de-a444dd701434 req-1bc38923-dc09-47fb-b89b-43a906b92861 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:28:06.110456 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-f371348f-b016-43f2-91de-a444dd701434 req-1bc38923-dc09-47fb-b89b-43a906b92861 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:28:06.132418 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-f371348f-b016-43f2-91de-a444dd701434 req-1bc38923-dc09-47fb-b89b-43a906b92861 service nova] Creating event network-changed:c82a6b32-3037-4286-bb2b-18dd88ac720a for instance f3651b0a-2a69-4504-af5a-734e98762539 on hv-cinder-80390 Aug 10 05:28:06.137445 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-f371348f-b016-43f2-91de-a444dd701434 req-1bc38923-dc09-47fb-b89b-43a906b92861 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039663 Aug 10 05:28:06.138098 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 542/1088] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:28:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:29:11.783325 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:29:11.783907 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: Tue Aug 10 05:29:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:30:03.239587 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2458c05e-063b-49f5-ab8b-be20473e7346] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 05:30:03.243122 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:03.243640 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:03.250703 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:03.251148 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:03.251912 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:03.252341 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:03.281878 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:30:03.479524 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [5146a453-2c59-413b-ae58-484711819355] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 05:30:04.257021 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] [2458c05e-063b-49f5-ab8b-be20473e7346] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33266. Aug 10 05:30:04.496165 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [5146a453-2c59-413b-ae58-484711819355] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33268. Aug 10 05:30:04.606887 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-cd08fa89-8809-483a-81f8-fec97427341c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 204 len: 0 microversion: 2.1 time: 1.368958 Aug 10 05:30:04.607468 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 547/1089] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:30:03 2021] DELETE /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 0 bytes in 1371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:30:04.614193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 05:30:04.618058 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-dcaa8a7c-0142-4bc7-815b-7905f983104c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:04.618835 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-dcaa8a7c-0142-4bc7-815b-7905f983104c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:04.624894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dcaa8a7c-0142-4bc7-815b-7905f983104c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:04.625349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dcaa8a7c-0142-4bc7-815b-7905f983104c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:04.626117 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dcaa8a7c-0142-4bc7-815b-7905f983104c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:04.626554 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-dcaa8a7c-0142-4bc7-815b-7905f983104c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:04.745498 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-dcaa8a7c-0142-4bc7-815b-7905f983104c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:04.752917 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-dcaa8a7c-0142-4bc7-815b-7905f983104c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1577 microversion: 2.1 time: 0.140975 Aug 10 05:30:04.753413 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 543/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:04 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1577 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:05.769822 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-19ef0d17-2013-42a6-9f9a-febd71f7485b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:05.770512 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-19ef0d17-2013-42a6-9f9a-febd71f7485b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:05.777032 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-19ef0d17-2013-42a6-9f9a-febd71f7485b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:05.777424 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-19ef0d17-2013-42a6-9f9a-febd71f7485b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:05.778190 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-19ef0d17-2013-42a6-9f9a-febd71f7485b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:05.778661 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-19ef0d17-2013-42a6-9f9a-febd71f7485b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:05.897529 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-19ef0d17-2013-42a6-9f9a-febd71f7485b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:05.905254 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-19ef0d17-2013-42a6-9f9a-febd71f7485b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1577 microversion: 2.1 time: 0.139459 Aug 10 05:30:05.905810 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 548/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:05 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1577 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:06.921979 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4d91a703-c967-4fc5-97af-ea1d47a154e9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:06.922649 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4d91a703-c967-4fc5-97af-ea1d47a154e9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:06.941700 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d91a703-c967-4fc5-97af-ea1d47a154e9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:06.944005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d91a703-c967-4fc5-97af-ea1d47a154e9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:06.944005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d91a703-c967-4fc5-97af-ea1d47a154e9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:06.944005 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4d91a703-c967-4fc5-97af-ea1d47a154e9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:06.949516 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33280. Aug 10 05:30:07.143110 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4d91a703-c967-4fc5-97af-ea1d47a154e9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:07.150688 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4d91a703-c967-4fc5-97af-ea1d47a154e9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1577 microversion: 2.1 time: 0.232294 Aug 10 05:30:07.151257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 544/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:06 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:07.616691 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-a9ce0144-d37e-483e-b272-5abeae759062 req-c321a6b8-715c-48f1-a8e6-d572a1c1dd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3651b0a-2a69-4504-af5a-734e98762539", "name": "network-vif-deleted", "tag": "c82a6b32-3037-4286-bb2b-18dd88ac720a"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:30:07.618207 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:30:07.618207 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:30:07.624988 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-a9ce0144-d37e-483e-b272-5abeae759062 req-c321a6b8-715c-48f1-a8e6-d572a1c1dd72 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:07.625375 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-a9ce0144-d37e-483e-b272-5abeae759062 req-c321a6b8-715c-48f1-a8e6-d572a1c1dd72 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:07.635956 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-a9ce0144-d37e-483e-b272-5abeae759062 req-c321a6b8-715c-48f1-a8e6-d572a1c1dd72 service nova] Creating event network-vif-deleted:c82a6b32-3037-4286-bb2b-18dd88ac720a for instance f3651b0a-2a69-4504-af5a-734e98762539 on hv-cinder-80390 Aug 10 05:30:07.640888 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-a9ce0144-d37e-483e-b272-5abeae759062 req-c321a6b8-715c-48f1-a8e6-d572a1c1dd72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027867 Aug 10 05:30:07.641460 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 549/1093] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:30:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:30:08.167591 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-03124efb-8aca-493e-a93b-d015f9a23059 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:08.168260 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-03124efb-8aca-493e-a93b-d015f9a23059 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:08.173951 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-03124efb-8aca-493e-a93b-d015f9a23059 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:08.174415 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-03124efb-8aca-493e-a93b-d015f9a23059 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:08.175218 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-03124efb-8aca-493e-a93b-d015f9a23059 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:08.175663 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-03124efb-8aca-493e-a93b-d015f9a23059 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:08.234254 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-03124efb-8aca-493e-a93b-d015f9a23059 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:08.242179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-03124efb-8aca-493e-a93b-d015f9a23059 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 200 len: 1224 microversion: 2.1 time: 0.078173 Aug 10 05:30:08.247066 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 545/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:08 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:09.260091 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:09.260783 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:09.266868 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:09.267313 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:09.268079 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:09.268511 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:09.281167 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] HTTP exception thrown: Instance f3651b0a-2a69-4504-af5a-734e98762539 could not be found. Aug 10 05:30:09.281746 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Returning 404 to user: Instance f3651b0a-2a69-4504-af5a-734e98762539 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:30:09.282622 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c37c764e-123a-4453-b11f-46e5b6e66969 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 404 len: 111 microversion: 2.1 time: 0.026612 Aug 10 05:30:09.283131 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 550/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:09 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:30:09.332257 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-954457554", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-870744261", "security_groups": [{"name": "tempest-secgroup-smoke-1701116513"}], "block_device_mapping_v2": [{"uuid": "21c40c8e-ef11-4939-bb02-4d56c5c86dfe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7cab1640-2f85-4ddc-abce-156c1a17acda"}]}} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:30:09.431843 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.network.neutron [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] validate_networks() for [('7cab1640-2f85-4ddc-abce-156c1a17acda', None, None, None)] {{(pid=108137) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:30:09.795167 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Flavor limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:30:09.795609 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Image limits 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:30:09.796218 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Flavor pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:30:09.796684 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Image pref 0:0:0 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:30:09.797098 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.virt.hardware [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108137) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:30:09.807095 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:09.807546 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:09.808348 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:09.808785 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:09.825166 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for project e654b562fb1b41608bcc31ea569d9473. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:30:09.829025 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.quota [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for user cbff6c12349d4e03988d56e7aad5982b and project e654b562fb1b41608bcc31ea569d9473. Resources: {'cores', 'ram', 'instances'} {{(pid=108137) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:30:09.887958 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Going to run 1 instances... {{(pid=108137) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:30:09.890067 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21c40c8e-ef11-4939-bb02-4d56c5c86dfe',volume_size=None,volume_type=None)] {{(pid=108137) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:30:10.271823 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c5f88ac9-61b3-42ac-89eb-037d3d29d53b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.943169 Aug 10 05:30:10.272462 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 546/1096] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:30:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:30:10.283310 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-01e3cc32-e070-4028-b282-a4db9519dd3c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:10.283917 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-01e3cc32-e070-4028-b282-a4db9519dd3c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:10.338331 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-01e3cc32-e070-4028-b282-a4db9519dd3c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:10.344783 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-01e3cc32-e070-4028-b282-a4db9519dd3c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1093 microversion: 2.1 time: 0.065244 Aug 10 05:30:10.345330 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 551/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:10 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:11.361198 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-98120136-f9e2-4141-abd3-6e34aaf55b55 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:11.362100 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-98120136-f9e2-4141-abd3-6e34aaf55b55 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:11.414040 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-98120136-f9e2-4141-abd3-6e34aaf55b55 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:11.421493 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-98120136-f9e2-4141-abd3-6e34aaf55b55 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1093 microversion: 2.1 time: 0.064326 Aug 10 05:30:11.422048 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 547/1098] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:11 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:12.439679 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-3f855135-9ff6-4c17-ad1f-0109cadd0cfe tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:12.440593 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-3f855135-9ff6-4c17-ad1f-0109cadd0cfe tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:12.493881 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-3f855135-9ff6-4c17-ad1f-0109cadd0cfe tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:12.502076 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-3f855135-9ff6-4c17-ad1f-0109cadd0cfe tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1093 microversion: 2.1 time: 0.068590 Aug 10 05:30:12.502653 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 552/1099] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:12 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:13.519156 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c111de39-bd30-4621-97c5-80ca28027daf tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:13.519771 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c111de39-bd30-4621-97c5-80ca28027daf tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:13.569646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c111de39-bd30-4621-97c5-80ca28027daf tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:13.576010 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c111de39-bd30-4621-97c5-80ca28027daf tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1093 microversion: 2.1 time: 0.060576 Aug 10 05:30:13.576548 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 548/1100] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:13 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1093 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:14.593281 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b1dccb5a-3bff-47b7-a7b0-9c345f4945bb tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:14.594083 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b1dccb5a-3bff-47b7-a7b0-9c345f4945bb tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:14.600065 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1dccb5a-3bff-47b7-a7b0-9c345f4945bb tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:14.600522 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1dccb5a-3bff-47b7-a7b0-9c345f4945bb tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:14.601288 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1dccb5a-3bff-47b7-a7b0-9c345f4945bb tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:14.601728 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b1dccb5a-3bff-47b7-a7b0-9c345f4945bb tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:14.658932 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b1dccb5a-3bff-47b7-a7b0-9c345f4945bb tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:14.665979 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b1dccb5a-3bff-47b7-a7b0-9c345f4945bb tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1143 microversion: 2.1 time: 0.076411 Aug 10 05:30:14.666532 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 553/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:14 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1143 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:15.682105 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-39be2d0d-7b2e-483b-8b79-8da578073662 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:15.682749 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-39be2d0d-7b2e-483b-8b79-8da578073662 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:15.688574 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-39be2d0d-7b2e-483b-8b79-8da578073662 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:15.689027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-39be2d0d-7b2e-483b-8b79-8da578073662 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:15.689792 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-39be2d0d-7b2e-483b-8b79-8da578073662 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:15.690228 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-39be2d0d-7b2e-483b-8b79-8da578073662 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:15.751810 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-39be2d0d-7b2e-483b-8b79-8da578073662 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:15.759143 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-39be2d0d-7b2e-483b-8b79-8da578073662 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1135 microversion: 2.1 time: 0.081278 Aug 10 05:30:15.760328 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 549/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:15 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:16.778952 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9b3cce99-9cb1-4650-82ee-32ac965df1c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:16.779492 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9b3cce99-9cb1-4650-82ee-32ac965df1c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:16.785332 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9b3cce99-9cb1-4650-82ee-32ac965df1c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:16.785788 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9b3cce99-9cb1-4650-82ee-32ac965df1c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:16.786552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9b3cce99-9cb1-4650-82ee-32ac965df1c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:16.787008 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9b3cce99-9cb1-4650-82ee-32ac965df1c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:16.846345 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-9b3cce99-9cb1-4650-82ee-32ac965df1c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:16.853924 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9b3cce99-9cb1-4650-82ee-32ac965df1c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1209 microversion: 2.1 time: 0.079477 Aug 10 05:30:16.854498 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 554/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:16 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1209 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:30:17.871571 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-4496fec0-e72b-4d44-9a56-7fff78fa9ab4 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:17.872175 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-4496fec0-e72b-4d44-9a56-7fff78fa9ab4 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:17.878004 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4496fec0-e72b-4d44-9a56-7fff78fa9ab4 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:17.878446 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4496fec0-e72b-4d44-9a56-7fff78fa9ab4 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:17.879314 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4496fec0-e72b-4d44-9a56-7fff78fa9ab4 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:17.879753 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-4496fec0-e72b-4d44-9a56-7fff78fa9ab4 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:17.993246 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-2369b2d8-bed9-4162-bad2-22190c2e9ec4 req-46078211-2742-4a66-a619-6e4ecfeb7abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b61d4f-880e-4993-9a76-79e13cd67be3", "tag": "79e241cd-694a-4cbe-ac17-ea2480a505f4"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:30:17.996016 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:30:17.996016 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:30:18.003951 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-2369b2d8-bed9-4162-bad2-22190c2e9ec4 req-46078211-2742-4a66-a619-6e4ecfeb7abe service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:18.010044 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-2369b2d8-bed9-4162-bad2-22190c2e9ec4 req-46078211-2742-4a66-a619-6e4ecfeb7abe service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:18.017925 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-2369b2d8-bed9-4162-bad2-22190c2e9ec4 req-46078211-2742-4a66-a619-6e4ecfeb7abe service nova] Creating event network-changed:79e241cd-694a-4cbe-ac17-ea2480a505f4 for instance 34b61d4f-880e-4993-9a76-79e13cd67be3 on hv-cinder-80390 Aug 10 05:30:18.024370 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-2369b2d8-bed9-4162-bad2-22190c2e9ec4 req-46078211-2742-4a66-a619-6e4ecfeb7abe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038157 Aug 10 05:30:18.025055 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 555/1104] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:30:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:30:18.091974 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-4496fec0-e72b-4d44-9a56-7fff78fa9ab4 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:18.101298 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-4496fec0-e72b-4d44-9a56-7fff78fa9ab4 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.233793 Aug 10 05:30:18.102241 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 550/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:17 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:19.119939 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-eb14c3b5-79a6-464b-bc22-eacc454d3fb6 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:19.120554 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-eb14c3b5-79a6-464b-bc22-eacc454d3fb6 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:19.126594 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eb14c3b5-79a6-464b-bc22-eacc454d3fb6 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:19.127056 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eb14c3b5-79a6-464b-bc22-eacc454d3fb6 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:19.127833 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eb14c3b5-79a6-464b-bc22-eacc454d3fb6 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:19.128265 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-eb14c3b5-79a6-464b-bc22-eacc454d3fb6 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:19.192051 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:30:19.192300 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: Tue Aug 10 05:30:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 (ip 10.222.0.16) !!! Aug 10 05:30:19.247916 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-eb14c3b5-79a6-464b-bc22-eacc454d3fb6 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:19.255210 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-eb14c3b5-79a6-464b-bc22-eacc454d3fb6 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.139895 Aug 10 05:30:19.255780 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 556/1106] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:19 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:20.272264 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-af2923d5-a86d-42f9-9f3d-edac1f406de2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:20.273298 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-af2923d5-a86d-42f9-9f3d-edac1f406de2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:20.279265 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af2923d5-a86d-42f9-9f3d-edac1f406de2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:20.279721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af2923d5-a86d-42f9-9f3d-edac1f406de2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:20.280492 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af2923d5-a86d-42f9-9f3d-edac1f406de2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:20.280931 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-af2923d5-a86d-42f9-9f3d-edac1f406de2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:20.399201 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-af2923d5-a86d-42f9-9f3d-edac1f406de2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:20.406904 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-af2923d5-a86d-42f9-9f3d-edac1f406de2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.138404 Aug 10 05:30:20.407463 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 551/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:20 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:21.423509 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-18ef71c5-2e23-4a35-8bf5-d42a4c58909b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:21.424134 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-18ef71c5-2e23-4a35-8bf5-d42a4c58909b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:21.429914 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18ef71c5-2e23-4a35-8bf5-d42a4c58909b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:21.430377 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18ef71c5-2e23-4a35-8bf5-d42a4c58909b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:21.431152 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18ef71c5-2e23-4a35-8bf5-d42a4c58909b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:21.431583 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-18ef71c5-2e23-4a35-8bf5-d42a4c58909b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:21.556623 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-18ef71c5-2e23-4a35-8bf5-d42a4c58909b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:21.563956 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-18ef71c5-2e23-4a35-8bf5-d42a4c58909b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.144194 Aug 10 05:30:21.564530 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 557/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:21 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:30:22.581335 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-cc712167-39eb-47d4-a34a-b79897c298b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:22.581335 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-cc712167-39eb-47d4-a34a-b79897c298b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:22.587133 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cc712167-39eb-47d4-a34a-b79897c298b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:22.587676 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cc712167-39eb-47d4-a34a-b79897c298b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:22.588431 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cc712167-39eb-47d4-a34a-b79897c298b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:22.588867 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-cc712167-39eb-47d4-a34a-b79897c298b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:22.707547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-cc712167-39eb-47d4-a34a-b79897c298b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:22.716302 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-cc712167-39eb-47d4-a34a-b79897c298b0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.139349 Aug 10 05:30:22.718641 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 552/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:22 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:23.732983 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0089c491-6e25-4fcd-9a3e-725afc4adde1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:23.733709 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0089c491-6e25-4fcd-9a3e-725afc4adde1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:23.740095 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0089c491-6e25-4fcd-9a3e-725afc4adde1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:23.740545 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0089c491-6e25-4fcd-9a3e-725afc4adde1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:23.741314 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0089c491-6e25-4fcd-9a3e-725afc4adde1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:23.741753 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0089c491-6e25-4fcd-9a3e-725afc4adde1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:23.865000 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0089c491-6e25-4fcd-9a3e-725afc4adde1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:23.872736 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0089c491-6e25-4fcd-9a3e-725afc4adde1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.143461 Aug 10 05:30:23.873301 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 558/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:23 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:24.889824 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-9d9da535-8bf1-4650-97b8-5e42ba838556 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:24.890436 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-9d9da535-8bf1-4650-97b8-5e42ba838556 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:24.896497 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d9da535-8bf1-4650-97b8-5e42ba838556 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:24.897027 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d9da535-8bf1-4650-97b8-5e42ba838556 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:24.897797 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d9da535-8bf1-4650-97b8-5e42ba838556 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:24.898234 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-9d9da535-8bf1-4650-97b8-5e42ba838556 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:25.017153 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-9d9da535-8bf1-4650-97b8-5e42ba838556 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:25.024298 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-9d9da535-8bf1-4650-97b8-5e42ba838556 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.139007 Aug 10 05:30:25.024854 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 553/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:24 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:26.040686 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c048d2e8-7a2f-4c7f-abca-ed8aee0a9025 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:26.041294 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c048d2e8-7a2f-4c7f-abca-ed8aee0a9025 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:26.047697 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c048d2e8-7a2f-4c7f-abca-ed8aee0a9025 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:26.048145 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c048d2e8-7a2f-4c7f-abca-ed8aee0a9025 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:26.048991 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c048d2e8-7a2f-4c7f-abca-ed8aee0a9025 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:26.049424 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c048d2e8-7a2f-4c7f-abca-ed8aee0a9025 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:26.163833 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-c048d2e8-7a2f-4c7f-abca-ed8aee0a9025 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:26.171573 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c048d2e8-7a2f-4c7f-abca-ed8aee0a9025 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.134497 Aug 10 05:30:26.172133 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 559/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:26 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:27.188652 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7675c3b2-3526-4c29-a206-fd6e765e131d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:27.189309 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7675c3b2-3526-4c29-a206-fd6e765e131d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:27.195227 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7675c3b2-3526-4c29-a206-fd6e765e131d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:27.195669 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7675c3b2-3526-4c29-a206-fd6e765e131d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:27.196430 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7675c3b2-3526-4c29-a206-fd6e765e131d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:27.196860 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7675c3b2-3526-4c29-a206-fd6e765e131d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:27.314308 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7675c3b2-3526-4c29-a206-fd6e765e131d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:27.321504 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7675c3b2-3526-4c29-a206-fd6e765e131d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.136586 Aug 10 05:30:27.322096 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 554/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:27 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:28.337561 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-d65a1b98-cb83-46a7-ae1b-5dfc536e8d99 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:28.338188 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-d65a1b98-cb83-46a7-ae1b-5dfc536e8d99 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:28.344531 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d65a1b98-cb83-46a7-ae1b-5dfc536e8d99 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:28.344977 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d65a1b98-cb83-46a7-ae1b-5dfc536e8d99 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:28.345742 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d65a1b98-cb83-46a7-ae1b-5dfc536e8d99 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:28.346175 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-d65a1b98-cb83-46a7-ae1b-5dfc536e8d99 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:28.467364 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-d65a1b98-cb83-46a7-ae1b-5dfc536e8d99 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:28.474465 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-d65a1b98-cb83-46a7-ae1b-5dfc536e8d99 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.140577 Aug 10 05:30:28.475053 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 560/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:28 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:29.041335 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-ee4a72df-7956-4046-a10d-211c33bcb8b1 req-b2e0d668-cd36-439e-878f-779b08174575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b61d4f-880e-4993-9a76-79e13cd67be3", "name": "network-vif-plugged", "status": "completed", "tag": "79e241cd-694a-4cbe-ac17-ea2480a505f4"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:30:29.049026 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:30:29.049026 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:30:29.050322 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-ee4a72df-7956-4046-a10d-211c33bcb8b1 req-b2e0d668-cd36-439e-878f-779b08174575 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:29.050797 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-ee4a72df-7956-4046-a10d-211c33bcb8b1 req-b2e0d668-cd36-439e-878f-779b08174575 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:29.061335 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-ee4a72df-7956-4046-a10d-211c33bcb8b1 req-b2e0d668-cd36-439e-878f-779b08174575 service nova] Creating event network-vif-plugged:79e241cd-694a-4cbe-ac17-ea2480a505f4 for instance 34b61d4f-880e-4993-9a76-79e13cd67be3 on hv-cinder-80390 Aug 10 05:30:29.066353 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-ee4a72df-7956-4046-a10d-211c33bcb8b1 req-b2e0d668-cd36-439e-878f-779b08174575 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028696 Aug 10 05:30:29.066953 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 555/1115] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:30:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:30:29.491083 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-0c82aeee-33d0-4213-ae56-14c80518e5f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:29.491697 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-0c82aeee-33d0-4213-ae56-14c80518e5f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:29.497684 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c82aeee-33d0-4213-ae56-14c80518e5f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:29.498136 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c82aeee-33d0-4213-ae56-14c80518e5f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:29.498953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c82aeee-33d0-4213-ae56-14c80518e5f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:29.499384 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-0c82aeee-33d0-4213-ae56-14c80518e5f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:29.618362 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-0c82aeee-33d0-4213-ae56-14c80518e5f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:29.625528 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-0c82aeee-33d0-4213-ae56-14c80518e5f9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1265 microversion: 2.1 time: 0.138315 Aug 10 05:30:29.626082 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 561/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:29 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:30.642270 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-195b21d0-c344-43b3-93bb-3876c7a022f1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:30.642926 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-195b21d0-c344-43b3-93bb-3876c7a022f1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:30.649192 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-195b21d0-c344-43b3-93bb-3876c7a022f1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:30.649638 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-195b21d0-c344-43b3-93bb-3876c7a022f1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:30.650405 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-195b21d0-c344-43b3-93bb-3876c7a022f1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:30.650863 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-195b21d0-c344-43b3-93bb-3876c7a022f1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:30.775439 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-195b21d0-c344-43b3-93bb-3876c7a022f1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:30.783595 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-195b21d0-c344-43b3-93bb-3876c7a022f1 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1452 microversion: 2.1 time: 0.145439 Aug 10 05:30:30.784162 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 556/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:30 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:30.801016 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-15a8f7c7-f2d0-43fb-b472-b7bfc5b39416 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:30:30.801620 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-15a8f7c7-f2d0-43fb-b472-b7bfc5b39416 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:30:30.807743 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15a8f7c7-f2d0-43fb-b472-b7bfc5b39416 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:30.808275 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15a8f7c7-f2d0-43fb-b472-b7bfc5b39416 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:30.809052 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15a8f7c7-f2d0-43fb-b472-b7bfc5b39416 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:30.809516 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-15a8f7c7-f2d0-43fb-b472-b7bfc5b39416 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:30.931777 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-15a8f7c7-f2d0-43fb-b472-b7bfc5b39416 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:30:30.939556 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-15a8f7c7-f2d0-43fb-b472-b7bfc5b39416 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1452 microversion: 2.1 time: 0.141901 Aug 10 05:30:30.940126 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 562/1118] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:30:30 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:30:33.007121 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-89d3c9a7-833f-496e-b736-e021256bd43b req-71257d11-fb52-4409-993f-0c11e9115e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b61d4f-880e-4993-9a76-79e13cd67be3", "tag": "79e241cd-694a-4cbe-ac17-ea2480a505f4"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:30:33.008634 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:30:33.008634 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:30:33.019422 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-89d3c9a7-833f-496e-b736-e021256bd43b req-71257d11-fb52-4409-993f-0c11e9115e9e service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:30:33.020103 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-89d3c9a7-833f-496e-b736-e021256bd43b req-71257d11-fb52-4409-993f-0c11e9115e9e service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:30:33.033313 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-89d3c9a7-833f-496e-b736-e021256bd43b req-71257d11-fb52-4409-993f-0c11e9115e9e service nova] Creating event network-changed:79e241cd-694a-4cbe-ac17-ea2480a505f4 for instance 34b61d4f-880e-4993-9a76-79e13cd67be3 on hv-cinder-80390 Aug 10 05:30:33.038206 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-89d3c9a7-833f-496e-b736-e021256bd43b req-71257d11-fb52-4409-993f-0c11e9115e9e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133386 Aug 10 05:30:33.039120 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 557/1119] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:30:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:30:38.879744 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:30:38.880291 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:30:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:32:12.499047 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-156395564", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-870744261", "security_groups": [{"name": "tempest-secgroup-smoke-1701116513"}], "block_device_mapping_v2": [{"uuid": "9dd7cac0-8772-4280-9361-7e2fa2bc0d02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7cab1640-2f85-4ddc-abce-156c1a17acda"}]}} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:32:12.718953 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.network.neutron [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] validate_networks() for [('7cab1640-2f85-4ddc-abce-156c1a17acda', None, None, None)] {{(pid=108136) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 10 05:32:13.116897 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Flavor limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 05:32:13.117321 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Image limits 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 05:32:13.117828 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Flavor pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 05:32:13.118242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Image pref 0:0:0 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 05:32:13.118686 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.virt.hardware [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108136) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 05:32:13.127295 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:13.127756 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:13.128571 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:13.129009 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:13.146628 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for project e654b562fb1b41608bcc31ea569d9473. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 10 05:32:13.150428 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.quota [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Getting quotas for user cbff6c12349d4e03988d56e7aad5982b and project e654b562fb1b41608bcc31ea569d9473. Resources: {'cores', 'ram', 'instances'} {{(pid=108136) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 10 05:32:13.208939 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Going to run 1 instances... {{(pid=108136) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 10 05:32:13.211071 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9dd7cac0-8772-4280-9361-7e2fa2bc0d02',volume_size=None,volume_type=None)] {{(pid=108136) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 10 05:32:13.588666 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [3dffd844-190f-4e0f-ae58-9bcd091a8911] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 05:32:14.605322 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [3dffd844-190f-4e0f-ae58-9bcd091a8911] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33462. Aug 10 05:32:14.609052 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b043e847-10f6-4f0f-9c83-f477b74e72ba tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.114624 Aug 10 05:32:14.609689 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 563/1120] 10.222.0.16 () {60 vars in 1147 bytes} [Tue Aug 10 05:32:12 2021] POST /compute/v2.1/servers => generated 406 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 05:32:14.618501 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 05:32:14.622912 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7d16a545-c448-44f7-83b9-e1f64108955b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:14.623615 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7d16a545-c448-44f7-83b9-e1f64108955b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:14.728129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7d16a545-c448-44f7-83b9-e1f64108955b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:14.734913 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7d16a545-c448-44f7-83b9-e1f64108955b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1093 microversion: 2.1 time: 0.118149 Aug 10 05:32:14.735474 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 558/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:14 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1093 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:15.752353 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-aa353f97-ac81-407c-bbd0-b30ba8dcf01c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:15.753049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-aa353f97-ac81-407c-bbd0-b30ba8dcf01c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:15.759854 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aa353f97-ac81-407c-bbd0-b30ba8dcf01c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:15.760310 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aa353f97-ac81-407c-bbd0-b30ba8dcf01c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:15.761082 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aa353f97-ac81-407c-bbd0-b30ba8dcf01c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:15.761521 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-aa353f97-ac81-407c-bbd0-b30ba8dcf01c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:15.819458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-aa353f97-ac81-407c-bbd0-b30ba8dcf01c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:15.826736 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-aa353f97-ac81-407c-bbd0-b30ba8dcf01c tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1135 microversion: 2.1 time: 0.078033 Aug 10 05:32:15.827366 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 564/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:15 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1135 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:16.843978 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-c9323f17-decd-474d-ab57-ba9bafc82132 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:16.844593 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-c9323f17-decd-474d-ab57-ba9bafc82132 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:16.862277 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9323f17-decd-474d-ab57-ba9bafc82132 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:16.862666 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9323f17-decd-474d-ab57-ba9bafc82132 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:16.863451 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9323f17-decd-474d-ab57-ba9bafc82132 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:16.863891 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-c9323f17-decd-474d-ab57-ba9bafc82132 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:16.869565 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] [f391ae7d-2cb3-4096-a3cf-032ec43e95e4] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33484. Aug 10 05:32:16.951669 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-c9323f17-decd-474d-ab57-ba9bafc82132 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:16.960029 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-c9323f17-decd-474d-ab57-ba9bafc82132 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1209 microversion: 2.1 time: 0.119104 Aug 10 05:32:16.960601 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 559/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:16 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1209 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:17.977803 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-97cb20aa-efe3-448f-9776-354ed9dae582 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:17.979241 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-97cb20aa-efe3-448f-9776-354ed9dae582 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:17.985493 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97cb20aa-efe3-448f-9776-354ed9dae582 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:17.985944 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97cb20aa-efe3-448f-9776-354ed9dae582 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:17.986743 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97cb20aa-efe3-448f-9776-354ed9dae582 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:17.987199 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-97cb20aa-efe3-448f-9776-354ed9dae582 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:18.082179 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-c8d1667a-b2f9-45a8-b717-50cf8c063bb0 req-d57ab1ca-9852-4d6a-9144-5e712401e4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a", "tag": "9b474bc0-bd88-4402-a1cc-1fcc5ed6139f"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:32:18.090864 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:32:18.090864 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:32:18.091457 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-c8d1667a-b2f9-45a8-b717-50cf8c063bb0 req-d57ab1ca-9852-4d6a-9144-5e712401e4c2 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:18.091761 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-c8d1667a-b2f9-45a8-b717-50cf8c063bb0 req-d57ab1ca-9852-4d6a-9144-5e712401e4c2 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:18.105036 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-c8d1667a-b2f9-45a8-b717-50cf8c063bb0 req-d57ab1ca-9852-4d6a-9144-5e712401e4c2 service nova] Creating event network-changed:9b474bc0-bd88-4402-a1cc-1fcc5ed6139f for instance 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a on hv-cinder-80390 Aug 10 05:32:18.114857 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-97cb20aa-efe3-448f-9776-354ed9dae582 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:18.120025 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-c8d1667a-b2f9-45a8-b717-50cf8c063bb0 req-d57ab1ca-9852-4d6a-9144-5e712401e4c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037430 Aug 10 05:32:18.120025 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 560/1124] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:32:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:32:18.123578 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-97cb20aa-efe3-448f-9776-354ed9dae582 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.150244 Aug 10 05:32:18.124201 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 565/1125] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:17 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:19.140894 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6e4be8c1-8264-44c0-85ef-5732e0feb981 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:19.141589 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6e4be8c1-8264-44c0-85ef-5732e0feb981 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:19.147634 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6e4be8c1-8264-44c0-85ef-5732e0feb981 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:19.154607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6e4be8c1-8264-44c0-85ef-5732e0feb981 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:19.154607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6e4be8c1-8264-44c0-85ef-5732e0feb981 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:19.154607 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6e4be8c1-8264-44c0-85ef-5732e0feb981 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:19.268045 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6e4be8c1-8264-44c0-85ef-5732e0feb981 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:19.275788 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6e4be8c1-8264-44c0-85ef-5732e0feb981 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.138871 Aug 10 05:32:19.276349 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 561/1126] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:19 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:20.292108 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-040eb4bb-aa0f-4e8c-9acb-96b71d705189 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:20.292739 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-040eb4bb-aa0f-4e8c-9acb-96b71d705189 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:20.298552 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-040eb4bb-aa0f-4e8c-9acb-96b71d705189 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:20.299028 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-040eb4bb-aa0f-4e8c-9acb-96b71d705189 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:20.299788 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-040eb4bb-aa0f-4e8c-9acb-96b71d705189 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:20.300217 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-040eb4bb-aa0f-4e8c-9acb-96b71d705189 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:20.418852 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-040eb4bb-aa0f-4e8c-9acb-96b71d705189 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:20.425914 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-040eb4bb-aa0f-4e8c-9acb-96b71d705189 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.137479 Aug 10 05:32:20.426467 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 566/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:20 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:21.442897 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bb813047-3de3-47a3-b7ca-2d6473db5f5b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:21.443506 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bb813047-3de3-47a3-b7ca-2d6473db5f5b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:21.449853 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bb813047-3de3-47a3-b7ca-2d6473db5f5b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:21.450295 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bb813047-3de3-47a3-b7ca-2d6473db5f5b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:21.451091 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bb813047-3de3-47a3-b7ca-2d6473db5f5b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:21.451525 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bb813047-3de3-47a3-b7ca-2d6473db5f5b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:21.572215 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-bb813047-3de3-47a3-b7ca-2d6473db5f5b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:21.579501 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bb813047-3de3-47a3-b7ca-2d6473db5f5b tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.140269 Aug 10 05:32:21.580060 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:21 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:22.596214 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-259d3eca-d841-4019-ba1e-20dd99f94f78 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:22.596820 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-259d3eca-d841-4019-ba1e-20dd99f94f78 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:22.603260 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-259d3eca-d841-4019-ba1e-20dd99f94f78 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:22.603712 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-259d3eca-d841-4019-ba1e-20dd99f94f78 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:22.604481 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-259d3eca-d841-4019-ba1e-20dd99f94f78 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:22.604913 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-259d3eca-d841-4019-ba1e-20dd99f94f78 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:22.723223 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-259d3eca-d841-4019-ba1e-20dd99f94f78 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:22.730420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-259d3eca-d841-4019-ba1e-20dd99f94f78 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.137956 Aug 10 05:32:22.735791 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 567/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:22 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:32:23.747124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-6d0a2158-2c3a-45d4-be38-cff9cd58b47d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:23.747718 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-6d0a2158-2c3a-45d4-be38-cff9cd58b47d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:23.753571 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6d0a2158-2c3a-45d4-be38-cff9cd58b47d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:23.754019 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6d0a2158-2c3a-45d4-be38-cff9cd58b47d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:23.754812 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6d0a2158-2c3a-45d4-be38-cff9cd58b47d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:23.755251 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-6d0a2158-2c3a-45d4-be38-cff9cd58b47d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:23.870293 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-6d0a2158-2c3a-45d4-be38-cff9cd58b47d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:23.877398 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-6d0a2158-2c3a-45d4-be38-cff9cd58b47d tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.133900 Aug 10 05:32:23.877964 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 563/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:23 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:24.893966 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-ff220c6e-44a7-405a-a656-225af4af6cdc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:24.894590 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-ff220c6e-44a7-405a-a656-225af4af6cdc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:24.901022 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff220c6e-44a7-405a-a656-225af4af6cdc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:24.901466 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff220c6e-44a7-405a-a656-225af4af6cdc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:24.902240 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff220c6e-44a7-405a-a656-225af4af6cdc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:24.902674 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-ff220c6e-44a7-405a-a656-225af4af6cdc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:25.017975 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-ff220c6e-44a7-405a-a656-225af4af6cdc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:25.025831 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-ff220c6e-44a7-405a-a656-225af4af6cdc tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.135512 Aug 10 05:32:25.026389 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 568/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:24 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:26.086858 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ddafc565-4b55-4082-93b9-c6e2fff5bed8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:26.087470 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ddafc565-4b55-4082-93b9-c6e2fff5bed8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:26.093205 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ddafc565-4b55-4082-93b9-c6e2fff5bed8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:26.093660 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ddafc565-4b55-4082-93b9-c6e2fff5bed8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:26.094428 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ddafc565-4b55-4082-93b9-c6e2fff5bed8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:26.094906 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ddafc565-4b55-4082-93b9-c6e2fff5bed8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:26.208993 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-ddafc565-4b55-4082-93b9-c6e2fff5bed8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:26.216601 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ddafc565-4b55-4082-93b9-c6e2fff5bed8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.178907 Aug 10 05:32:26.217193 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 564/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:26 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:27.233605 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-94c1d490-475c-4f20-ba85-ae640db69e37 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:27.234214 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-94c1d490-475c-4f20-ba85-ae640db69e37 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:27.240356 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94c1d490-475c-4f20-ba85-ae640db69e37 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:27.241448 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94c1d490-475c-4f20-ba85-ae640db69e37 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:27.242199 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94c1d490-475c-4f20-ba85-ae640db69e37 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:27.242657 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-94c1d490-475c-4f20-ba85-ae640db69e37 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:27.628173 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-94c1d490-475c-4f20-ba85-ae640db69e37 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:27.635546 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-94c1d490-475c-4f20-ba85-ae640db69e37 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.405532 Aug 10 05:32:27.636096 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 569/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:27 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:28.651970 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a027a814-106d-4713-835d-06b4e516f0dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:28.652577 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a027a814-106d-4713-835d-06b4e516f0dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:28.658372 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a027a814-106d-4713-835d-06b4e516f0dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:28.658851 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a027a814-106d-4713-835d-06b4e516f0dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:28.659606 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a027a814-106d-4713-835d-06b4e516f0dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:28.660032 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a027a814-106d-4713-835d-06b4e516f0dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:28.777534 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-a027a814-106d-4713-835d-06b4e516f0dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:28.785813 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a027a814-106d-4713-835d-06b4e516f0dd tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.137504 Aug 10 05:32:28.786392 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 565/1134] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:28 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:29.663343 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-0e60d2d2-c402-4200-a3c3-dc2921d0b232 req-0d29a879-6c39-48ad-8c11-f33df29427b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a", "name": "network-vif-plugged", "status": "completed", "tag": "9b474bc0-bd88-4402-a1cc-1fcc5ed6139f"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:32:29.664892 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:32:29.664892 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:32:29.671565 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-0e60d2d2-c402-4200-a3c3-dc2921d0b232 req-0d29a879-6c39-48ad-8c11-f33df29427b9 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:29.672008 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-0e60d2d2-c402-4200-a3c3-dc2921d0b232 req-0d29a879-6c39-48ad-8c11-f33df29427b9 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:29.682373 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-0e60d2d2-c402-4200-a3c3-dc2921d0b232 req-0d29a879-6c39-48ad-8c11-f33df29427b9 service nova] Creating event network-vif-plugged:9b474bc0-bd88-4402-a1cc-1fcc5ed6139f for instance 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a on hv-cinder-80390 Aug 10 05:32:29.687598 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-0e60d2d2-c402-4200-a3c3-dc2921d0b232 req-0d29a879-6c39-48ad-8c11-f33df29427b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080437 Aug 10 05:32:29.688153 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 570/1135] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:32:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:32:29.802110 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-5a1e9bec-3720-4035-8f74-c47f07ea3b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:29.802751 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-5a1e9bec-3720-4035-8f74-c47f07ea3b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:29.809041 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a1e9bec-3720-4035-8f74-c47f07ea3b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:29.809498 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a1e9bec-3720-4035-8f74-c47f07ea3b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:29.810266 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a1e9bec-3720-4035-8f74-c47f07ea3b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:29.810738 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-5a1e9bec-3720-4035-8f74-c47f07ea3b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:29.926603 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-5a1e9bec-3720-4035-8f74-c47f07ea3b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:29.934439 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-5a1e9bec-3720-4035-8f74-c47f07ea3b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.135968 Aug 10 05:32:29.935024 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 566/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:29 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:30.952685 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b5f3cc6e-5c07-4c03-9b52-45efc28b94af tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:30.953369 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b5f3cc6e-5c07-4c03-9b52-45efc28b94af tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:30.960151 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b5f3cc6e-5c07-4c03-9b52-45efc28b94af tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:30.962474 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b5f3cc6e-5c07-4c03-9b52-45efc28b94af tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:30.962474 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b5f3cc6e-5c07-4c03-9b52-45efc28b94af tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:30.962474 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b5f3cc6e-5c07-4c03-9b52-45efc28b94af tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:31.081825 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b5f3cc6e-5c07-4c03-9b52-45efc28b94af tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:31.089999 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b5f3cc6e-5c07-4c03-9b52-45efc28b94af tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1265 microversion: 2.1 time: 0.141357 Aug 10 05:32:31.090565 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 571/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:30 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:32.107043 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-171a0799-dd84-42f1-9e18-9220f7b5443e tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:32.107651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-171a0799-dd84-42f1-9e18-9220f7b5443e tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:32.113504 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-171a0799-dd84-42f1-9e18-9220f7b5443e tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:32.113954 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-171a0799-dd84-42f1-9e18-9220f7b5443e tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:32.115006 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-171a0799-dd84-42f1-9e18-9220f7b5443e tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:32.115446 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-171a0799-dd84-42f1-9e18-9220f7b5443e tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:32.233796 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-171a0799-dd84-42f1-9e18-9220f7b5443e tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:32.241350 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-171a0799-dd84-42f1-9e18-9220f7b5443e tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1453 microversion: 2.1 time: 0.137925 Aug 10 05:32:32.241969 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 567/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:32 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:32.261231 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2b701a75-201d-41ff-9944-a34d9c1e71e5 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:32:32.261841 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2b701a75-201d-41ff-9944-a34d9c1e71e5 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:32:32.267706 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b701a75-201d-41ff-9944-a34d9c1e71e5 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:32.268157 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b701a75-201d-41ff-9944-a34d9c1e71e5 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:32.268926 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b701a75-201d-41ff-9944-a34d9c1e71e5 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:32.269360 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2b701a75-201d-41ff-9944-a34d9c1e71e5 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:32.385458 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-2b701a75-201d-41ff-9944-a34d9c1e71e5 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:32:32.392851 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2b701a75-201d-41ff-9944-a34d9c1e71e5 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1453 microversion: 2.1 time: 0.135256 Aug 10 05:32:32.393416 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 572/1139] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:32:32 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:32:34.199780 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-41a18d96-7cb8-4161-9536-956cb9e2c602 req-b8b2c10b-b0cb-4201-bd5d-2a1c8efba833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a", "tag": "9b474bc0-bd88-4402-a1cc-1fcc5ed6139f"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:32:34.201711 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:32:34.201711 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:32:34.208570 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-41a18d96-7cb8-4161-9536-956cb9e2c602 req-b8b2c10b-b0cb-4201-bd5d-2a1c8efba833 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:32:34.209083 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-41a18d96-7cb8-4161-9536-956cb9e2c602 req-b8b2c10b-b0cb-4201-bd5d-2a1c8efba833 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:32:34.219750 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-41a18d96-7cb8-4161-9536-956cb9e2c602 req-b8b2c10b-b0cb-4201-bd5d-2a1c8efba833 service nova] Creating event network-changed:9b474bc0-bd88-4402-a1cc-1fcc5ed6139f for instance 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a on hv-cinder-80390 Aug 10 05:32:34.224913 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-41a18d96-7cb8-4161-9536-956cb9e2c602 req-b8b2c10b-b0cb-4201-bd5d-2a1c8efba833 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028811 Aug 10 05:32:34.225977 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 568/1140] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:32:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:33:39.209854 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:33:39.210482 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: Tue Aug 10 05:33:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:33:58.899331 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:33:58.899928 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:33:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:34:13.649916 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-c588d036-3602-4091-95ed-ef142008b9c8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:13.650420 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c588d036-3602-4091-95ed-ef142008b9c8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:13.653378 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2458c05e-063b-49f5-ab8b-be20473e7346] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 05:34:13.658438 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-3a7023e5-976f-4734-8c79-749713198a5c req-6eab0196-fd48-4ae7-849f-311750b2b05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a", "tag": "9b474bc0-bd88-4402-a1cc-1fcc5ed6139f"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:34:13.659929 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:34:13.659929 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:34:13.666105 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c588d036-3602-4091-95ed-ef142008b9c8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:13.666560 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c588d036-3602-4091-95ed-ef142008b9c8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:13.667145 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-3a7023e5-976f-4734-8c79-749713198a5c req-6eab0196-fd48-4ae7-849f-311750b2b05a service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:13.667586 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c588d036-3602-4091-95ed-ef142008b9c8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:13.667721 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-3a7023e5-976f-4734-8c79-749713198a5c req-6eab0196-fd48-4ae7-849f-311750b2b05a service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:13.668429 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-c588d036-3602-4091-95ed-ef142008b9c8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:13.678547 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-3a7023e5-976f-4734-8c79-749713198a5c req-6eab0196-fd48-4ae7-849f-311750b2b05a service nova] Creating event network-changed:9b474bc0-bd88-4402-a1cc-1fcc5ed6139f for instance 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a on hv-cinder-80390 Aug 10 05:34:13.684124 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-3a7023e5-976f-4734-8c79-749713198a5c req-6eab0196-fd48-4ae7-849f-311750b2b05a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038328 Aug 10 05:34:13.684785 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 569/1141] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:34:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:34:13.694462 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-c588d036-3602-4091-95ed-ef142008b9c8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Going to try to terminate instance {{(pid=108136) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:34:14.019312 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-c588d036-3602-4091-95ed-ef142008b9c8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "DELETE /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 204 len: 0 microversion: 2.1 time: 0.376103 Aug 10 05:34:14.019937 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 573/1142] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:34:13 2021] DELETE /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:34:14.028969 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-8161d8bd-3ecc-4c5b-bdc3-ae7687ec92b8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:14.029671 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-8161d8bd-3ecc-4c5b-bdc3-ae7687ec92b8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:14.036151 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8161d8bd-3ecc-4c5b-bdc3-ae7687ec92b8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:14.036602 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8161d8bd-3ecc-4c5b-bdc3-ae7687ec92b8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:14.037393 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8161d8bd-3ecc-4c5b-bdc3-ae7687ec92b8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:14.037834 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-8161d8bd-3ecc-4c5b-bdc3-ae7687ec92b8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:14.237442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-8161d8bd-3ecc-4c5b-bdc3-ae7687ec92b8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:34:14.246965 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-8161d8bd-3ecc-4c5b-bdc3-ae7687ec92b8 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1578 microversion: 2.1 time: 0.222554 Aug 10 05:34:14.248255 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 570/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:14 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:34:15.265543 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-db10e705-cfb7-48e4-8b1e-00118b9a93be tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:15.266267 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-db10e705-cfb7-48e4-8b1e-00118b9a93be tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:15.283662 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-db10e705-cfb7-48e4-8b1e-00118b9a93be tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:15.284115 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-db10e705-cfb7-48e4-8b1e-00118b9a93be tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:15.284884 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-db10e705-cfb7-48e4-8b1e-00118b9a93be tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:15.285319 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-db10e705-cfb7-48e4-8b1e-00118b9a93be tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:15.291049 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] [2458c05e-063b-49f5-ab8b-be20473e7346] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33584. Aug 10 05:34:15.405242 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-db10e705-cfb7-48e4-8b1e-00118b9a93be tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:34:15.412541 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-db10e705-cfb7-48e4-8b1e-00118b9a93be tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1459 microversion: 2.1 time: 0.151036 Aug 10 05:34:15.413098 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 574/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:15 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:34:16.432586 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-063acd85-f289-456f-9de5-b22268cda129 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:16.433257 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-063acd85-f289-456f-9de5-b22268cda129 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:16.439382 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-063acd85-f289-456f-9de5-b22268cda129 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:16.439563 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [req-173a27e7-c845-4a9e-8cdf-89ebfb76693b req-ddd46b6c-27b3-486c-99b3-7631763e56bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a", "name": "network-vif-deleted", "tag": "9b474bc0-bd88-4402-a1cc-1fcc5ed6139f"}]} {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:34:16.440019 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-063acd85-f289-456f-9de5-b22268cda129 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:16.440578 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-063acd85-f289-456f-9de5-b22268cda129 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:16.440871 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:34:16.440871 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: warnings.warn(msg) Aug 10 05:34:16.441067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-063acd85-f289-456f-9de5-b22268cda129 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:16.447623 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-173a27e7-c845-4a9e-8cdf-89ebfb76693b req-ddd46b6c-27b3-486c-99b3-7631763e56bf service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:16.448074 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [req-173a27e7-c845-4a9e-8cdf-89ebfb76693b req-ddd46b6c-27b3-486c-99b3-7631763e56bf service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:16.460870 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.compute.server_external_events [req-173a27e7-c845-4a9e-8cdf-89ebfb76693b req-ddd46b6c-27b3-486c-99b3-7631763e56bf service nova] Creating event network-vif-deleted:9b474bc0-bd88-4402-a1cc-1fcc5ed6139f for instance 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a on hv-cinder-80390 Aug 10 05:34:16.466557 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [req-173a27e7-c845-4a9e-8cdf-89ebfb76693b req-ddd46b6c-27b3-486c-99b3-7631763e56bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079806 Aug 10 05:34:16.467196 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 571/1145] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:34:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:34:16.504117 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-063acd85-f289-456f-9de5-b22268cda129 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:34:16.512000 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-063acd85-f289-456f-9de5-b22268cda129 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1391 microversion: 2.1 time: 0.086293 Aug 10 05:34:16.512564 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 575/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:16 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1391 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 05:34:17.528951 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:17.529646 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:17.535770 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:17.536216 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:17.539141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:17.539141 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:17.568286 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:17.569458 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:17.569458 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.objects.instance [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lazy-loading 'fault' on Instance uuid 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a {{(pid=108137) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 05:34:17.607839 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:34:17.615178 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-bdea8107-87f2-409f-95d8-3a404f872e6f tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 200 len: 1229 microversion: 2.1 time: 0.090386 Aug 10 05:34:17.615770 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 572/1147] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:17 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:34:18.632799 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:18.633440 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:18.639911 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:18.640366 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:18.641127 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:18.641626 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:18.654638 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] HTTP exception thrown: Instance 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a could not be found. Aug 10 05:34:18.655159 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Returning 404 to user: Instance 85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:34:18.656025 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-9142ef01-5921-4e87-a21f-0100134f8126 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a" status: 404 len: 111 microversion: 2.1 time: 0.026875 Aug 10 05:34:18.656527 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 576/1148] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:18 2021] GET /compute/v2.1/servers/85ae0f0e-9ea5-4dcc-b047-58a91fb2ca3a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:34:21.959185 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-a8b1eabd-86ec-4a3d-9aa1-1a16238a6e63 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:21.959798 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a8b1eabd-86ec-4a3d-9aa1-1a16238a6e63 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:21.962226 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-24dd0264-3087-43f1-b86c-4d280c9fc432 req-da2aa97c-5e62-4244-aa3c-230a46f11e48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b61d4f-880e-4993-9a76-79e13cd67be3", "tag": "79e241cd-694a-4cbe-ac17-ea2480a505f4"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:34:21.964675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:34:21.964675 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:34:21.966429 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8b1eabd-86ec-4a3d-9aa1-1a16238a6e63 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:21.967018 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8b1eabd-86ec-4a3d-9aa1-1a16238a6e63 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:21.968091 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8b1eabd-86ec-4a3d-9aa1-1a16238a6e63 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:21.968555 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-a8b1eabd-86ec-4a3d-9aa1-1a16238a6e63 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:21.971930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-24dd0264-3087-43f1-b86c-4d280c9fc432 req-da2aa97c-5e62-4244-aa3c-230a46f11e48 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:21.972383 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-24dd0264-3087-43f1-b86c-4d280c9fc432 req-da2aa97c-5e62-4244-aa3c-230a46f11e48 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:21.984593 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-24dd0264-3087-43f1-b86c-4d280c9fc432 req-da2aa97c-5e62-4244-aa3c-230a46f11e48 service nova] Creating event network-changed:79e241cd-694a-4cbe-ac17-ea2480a505f4 for instance 34b61d4f-880e-4993-9a76-79e13cd67be3 on hv-cinder-80390 Aug 10 05:34:21.989977 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-24dd0264-3087-43f1-b86c-4d280c9fc432 req-da2aa97c-5e62-4244-aa3c-230a46f11e48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031628 Aug 10 05:34:21.993934 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 577/1149] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:34:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:34:21.999631 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-a8b1eabd-86ec-4a3d-9aa1-1a16238a6e63 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Going to try to terminate instance {{(pid=108137) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 10 05:34:22.268218 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-a8b1eabd-86ec-4a3d-9aa1-1a16238a6e63 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 204 len: 0 microversion: 2.1 time: 0.312666 Aug 10 05:34:22.268998 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 573/1150] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:34:21 2021] DELETE /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 05:34:22.277262 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-b7faf759-e63f-4dd3-9b3d-49c782e71b10 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:22.278067 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-b7faf759-e63f-4dd3-9b3d-49c782e71b10 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:22.284447 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b7faf759-e63f-4dd3-9b3d-49c782e71b10 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:22.284970 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b7faf759-e63f-4dd3-9b3d-49c782e71b10 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:22.285945 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b7faf759-e63f-4dd3-9b3d-49c782e71b10 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:22.286540 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-b7faf759-e63f-4dd3-9b3d-49c782e71b10 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:22.682315 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.policy [None req-b7faf759-e63f-4dd3-9b3d-49c782e71b10 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108136) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:34:22.689776 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-b7faf759-e63f-4dd3-9b3d-49c782e71b10 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1577 microversion: 2.1 time: 0.416528 Aug 10 05:34:22.690336 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 578/1151] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:22 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1577 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:34:23.706715 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-7cd89595-61f8-4570-9d28-9c16e36be4c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:23.707442 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-7cd89595-61f8-4570-9d28-9c16e36be4c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:23.713400 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7cd89595-61f8-4570-9d28-9c16e36be4c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:23.713926 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7cd89595-61f8-4570-9d28-9c16e36be4c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:23.715309 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7cd89595-61f8-4570-9d28-9c16e36be4c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:23.715753 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-7cd89595-61f8-4570-9d28-9c16e36be4c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:23.833102 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-7cd89595-61f8-4570-9d28-9c16e36be4c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:34:23.840945 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-7cd89595-61f8-4570-9d28-9c16e36be4c2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1458 microversion: 2.1 time: 0.138211 Aug 10 05:34:23.841495 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 574/1152] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:23 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1458 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:34:24.572798 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [req-818af2c8-2314-4c10-9018-ab8d8b788b6e req-409f96d5-ee3e-4127-99b9-95f4b29a7462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b61d4f-880e-4993-9a76-79e13cd67be3", "name": "network-vif-deleted", "tag": "79e241cd-694a-4cbe-ac17-ea2480a505f4"}]} {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 05:34:24.574407 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:34:24.574407 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: warnings.warn(msg) Aug 10 05:34:24.581211 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-818af2c8-2314-4c10-9018-ab8d8b788b6e req-409f96d5-ee3e-4127-99b9-95f4b29a7462 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:24.581688 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [req-818af2c8-2314-4c10-9018-ab8d8b788b6e req-409f96d5-ee3e-4127-99b9-95f4b29a7462 service nova] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:24.591987 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.compute.server_external_events [req-818af2c8-2314-4c10-9018-ab8d8b788b6e req-409f96d5-ee3e-4127-99b9-95f4b29a7462 service nova] Creating event network-vif-deleted:79e241cd-694a-4cbe-ac17-ea2480a505f4 for instance 34b61d4f-880e-4993-9a76-79e13cd67be3 on hv-cinder-80390 Aug 10 05:34:24.596704 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [req-818af2c8-2314-4c10-9018-ab8d8b788b6e req-409f96d5-ee3e-4127-99b9-95f4b29a7462 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027511 Aug 10 05:34:24.597258 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 579/1153] 10.222.0.16 () {64 vars in 1318 bytes} [Tue Aug 10 05:34:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 05:34:24.857790 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-39e3a193-c287-432f-8e66-b732332ecba0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:24.858529 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-39e3a193-c287-432f-8e66-b732332ecba0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:24.864689 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-39e3a193-c287-432f-8e66-b732332ecba0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:24.865140 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-39e3a193-c287-432f-8e66-b732332ecba0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:24.865919 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-39e3a193-c287-432f-8e66-b732332ecba0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:24.866355 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-39e3a193-c287-432f-8e66-b732332ecba0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:24.928037 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.policy [None req-39e3a193-c287-432f-8e66-b732332ecba0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbff6c12349d4e03988d56e7aad5982b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e654b562fb1b41608bcc31ea569d9473', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108137) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 05:34:24.935930 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-39e3a193-c287-432f-8e66-b732332ecba0 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 200 len: 1224 microversion: 2.1 time: 0.082490 Aug 10 05:34:24.939157 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 575/1154] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:24 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 05:34:25.952649 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:25.953276 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: 34b61d4f-880e-4993-9a76-79e13cd67be3] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:25.959393 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:25.959874 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:25.960646 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:25.961087 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:25.973930 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] HTTP exception thrown: Instance 34b61d4f-880e-4993-9a76-79e13cd67be3 could not be found. Aug 10 05:34:25.974512 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Returning 404 to user: Instance 34b61d4f-880e-4993-9a76-79e13cd67be3 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:34:25.975354 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-2f759b51-2129-464a-9a54-4b6d5aa8bb08 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3" status: 404 len: 111 microversion: 2.1 time: 0.026992 Aug 10 05:34:25.975867 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 580/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:25 2021] GET /compute/v2.1/servers/34b61d4f-880e-4993-9a76-79e13cd67be3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:34:26.479893 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:26.480521 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.compute.api [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108137) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:26.486832 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:26.487324 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:26.488091 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:26.488558 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG oslo_concurrency.lockutils [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:26.502528 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.wsgi [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] HTTP exception thrown: Instance f3651b0a-2a69-4504-af5a-734e98762539 could not be found. Aug 10 05:34:26.504604 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Returning 404 to user: Instance f3651b0a-2a69-4504-af5a-734e98762539 could not be found. {{(pid=108137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:34:26.504604 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-ce030595-cf24-4f13-94f6-0e3d1a3caad2 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 404 len: 111 microversion: 2.1 time: 0.027932 Aug 10 05:34:26.504604 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 576/1156] 10.222.0.16 () {58 vars in 1239 bytes} [Tue Aug 10 05:34:26 2021] DELETE /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:34:26.512474 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '>' {{(pid=108136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:26.513092 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.compute.api [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] [instance: f3651b0a-2a69-4504-af5a-734e98762539] Fetching instance by UUID {{(pid=108136) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 10 05:34:26.518931 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:26.519407 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:26.520174 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 10 05:34:26.520616 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG oslo_concurrency.lockutils [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Lock "a1be71ff-2ee5-4b4d-a84d-8955d5d6ad7e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 10 05:34:26.535735 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.wsgi [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] HTTP exception thrown: Instance f3651b0a-2a69-4504-af5a-734e98762539 could not be found. Aug 10 05:34:26.536327 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: DEBUG nova.api.openstack.wsgi [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Returning 404 to user: Instance f3651b0a-2a69-4504-af5a-734e98762539 could not be found. {{(pid=108136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 10 05:34:26.537156 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO nova.api.openstack.requestlog [None req-120269cf-74dd-4367-99ac-06e673acd7b9 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539" status: 404 len: 111 microversion: 2.1 time: 0.028399 Aug 10 05:34:26.537682 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: [pid: 108136|app: 0|req: 581/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Tue Aug 10 05:34:26 2021] GET /compute/v2.1/servers/f3651b0a-2a69-4504-af5a-734e98762539 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 05:34:28.021129 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: DEBUG nova.api.openstack.wsgi [None req-2b18d76c-2290-462f-aa76-6bd654e05b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] Calling method '.version_select at 0x7fb33c362430>' {{(pid=108137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 05:34:28.103210 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO nova.api.openstack.requestlog [None req-2b18d76c-2290-462f-aa76-6bd654e05b19 tempest-TestVolumeBootPattern-1081217427 tempest-TestVolumeBootPattern-1081217427-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-870744261" status: 202 len: 0 microversion: 2.1 time: 0.085745 Aug 10 05:34:28.103783 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: [pid: 108137|app: 0|req: 577/1158] 10.222.0.16 () {58 vars in 1260 bytes} [Tue Aug 10 05:34:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-870744261 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 05:35:33.042596 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:35:33.043410 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:35:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:36:59.227826 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:36:59.228440 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: Tue Aug 10 05:36:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:37:18.916410 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:37:18.916960 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:37:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:37:29.627651 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:37:29.628247 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:37:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:37:31.806801 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:37:31.807435 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: Tue Aug 10 05:37:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:37:42.197557 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:37:42.198206 dv-cinder-803901-2-iscsi devstack@n-api.service[108136]: Tue Aug 10 05:37:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 05:38:53.060475 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 05:38:53.061055 dv-cinder-803901-2-iscsi devstack@n-api.service[108137]: Tue Aug 10 05:38:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!